Work in Progress (Following are the lecture notes of Prof Percy Liang/Prof Dorsa Sadigh - CS221 - Stanford. This is my interpretation of their excellent teaching and I take full responsibility of any misinterpretation or misinformation provided herein.)
Linear Predictors¶
Application: spam classification¶
Input x = email message Output y $\in$ {spam, not spam}
Types of prediction tasks
- Binary classification (email $\Rightarrow$ spam/not spam)
$x \rightarrow \fbox{f} \rightarrow y \in ${+1, -1}
- Regression (location, year $\Rightarrow$ housing price)
$x \rightarrow \fbox{f} \rightarrow y \in \mathbb R$
- Multiclass classification: y is a category
100 Images $\rightarrow \fbox{f} \rightarrow cat$
- Ranking: y is a permutation
1 2 3 4 $\rightarrow \fbox{f} \rightarrow$ 2 3 4 1
- Structured prediction: build from parts, construct
la casa blue $\rightarrow \fbox{f} \rightarrow$ the blue house
- many more..
Feature extraction¶
- What properties of x might be relevant for predicting y?
Input $\xrightarrow[\text{}]{\text{feature extractor}} \fbox{Feature Name: Feature Value}$
$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$
Feature vector¶
$\phi(x) \in \mathbb R^{d} $
Weight vector¶
- $\in \mathbb R^{d} $
Score¶
- weighted combinations of features $\in \mathbb R $
- the score on an example (x,y) is $w.\phi(x)$, how confident we are in predicting +1
- the magnitude of w does not matter, as the orthogonal vector(decision boundary) will still be the same
- when used for prediction, the magnitude of boundary does not matter
- when used for learning, the magnitude matters
$w.\phi(x) = \sum_{j=1}^{d}w_{j}\phi(x)_{j}$
Linear classifier (predictor)¶
- binary in this case: $f_{w}$
$f_{w} = \text{sign}(w.\phi(x)) = \begin{cases} +1 & \text{if $w.\phi(x) > 0$}\\ -1 & \text{if $w.\phi(x) < 0$}\\ ? & \text{if $w.\phi(x) = 0$} \end{cases} $
- Example:
- w = [2,-1]
- $\phi(x) \in \{[2,0],[0,2],[2,4]\}$
$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$
Margin¶
- Margin on an example (x,y) is $(w.\phi(x))y$, how correct we are
- Margin less than 0 means that y and scores are different signs are there is a mistake
Zero-one (0-1) loss¶
- did you make mist
$\begin{split} \text{Loss}_{0-1}(x,y,w) & = \mathbb 1[f_{w} \neq y] \\ & = \mathbb 1[(w.\phi(x))y \le 0] \\ & = \mathbb 1[\text{Margin} \le 0] \end{split}$
- is an indicator function that takes condition and returns 1 or 0
- if condition is true, returns 1, else 0
- if margin is less than 0, we have made a mistake
$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$
- Loss function: how good is a predictor?
- its a number, which helps us understand if we are satisfied with the prediction, if we use w to make prediction on x when the correct output is y
- Loss is on a particular example(residual square), TrainLoss is on a complete set(sum of residual square)
- High loss is bad, low loss is good
Squared Loss(x,y,w)$= (f_{w}(x)-y)^{2} = (w.\phi(x) - y)^{2}$
Train Loss(w)$=\frac{1}{|\mathbb D_{train}|}\sum_{(x,y)\in\mathbb D_{\text{train}}}\text{Loss(x,y,w)}$
$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$
Optimization algorithm¶
how to compute best?
- Goal: min$_{w}$TrainLoss(w)
- gradient $\nabla_{w}$TrainLoss(w) is the direction that increases the training loss the most
- use chain rule and do derivative
step size $\eta$
Initialize w = [0,..0]
For t = 1,..,T: (epochs)
$\ \ \ w \leftarrow w - \eta\nabla_{w}$TrainLoss(w)Level curves
- If prediction = target, gradient is zero
$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$
$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$
Learner¶
- Optimization problem
- what properties do we want the classifier to have in terms of data
Optimization algorithm
- how to optimize this
Loss function Loss(x,y,w) quantifies
Gradient Descent¶
- Gradient descent is slow
- gradient is calculation of the training loss
- and training loss is the sum of all the points
- which makes it expensive
- how to avoid this?
- Stochastic gradient descent
- Rather than looping through all the training examples to compute a single gradient and making one step(which is expensive)
- loop through the example and update the weight w based on each example
- update wont be good, but can make many more updates
- Stochastic gradient descent
$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$
- Step size
- 0 - too conservative
- 1 - too aggressive
- Strategy
> Constant: $\eta = 0.1$
> Decreasing: $\eta = 1/\sqrt{\text{# updates made so far}}$ Classification - Will SGD work on 0-1Loss?¶
- No? Why?
- 1) Its not differentiable
- 2) The gradient is zero everywhere other than at 0, which does not matter
- The weights will not move
$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$
- How to solve this?
- Make the gradient non-zero
- Hinge loss
- Loss$_{hinge}(x,y,w) = \text{max}\{1-(w.\phi(x))y, 0\}$
$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$
- Calculate gradient of this hinge loss
> $\nabla\text{Loss}_{hinge}(x,y,w) =
\begin{cases}
-\phi{(x)}y & \text{if} \{1-(w.\phi(x))y\} > \{0\} \\
0 & \text{otherwise}
\end{cases}
$
> or
> $\nabla\text{Loss}_{hinge}(x,y,w) =
\begin{cases}
0 & \text{if} \{w.\phi(x))y\} > \{1\} \\
-\phi{(x)}y & \text{otherwise}
\end{cases}
$
- Other type of loss function for classification
- Logistic
$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$
Example - Gradient Descent - Vectorized¶
In [1]:
# %load lec02-c02-gradientDescentVectorized.py
import pandas as pd
import numpy as np
# pd.set_option('display.max_columns', None)
# pd.set_option('display.max_colwidth', None)
##############################################
# Model
# points = [(np.array([2]),4), (np.array([4]),2)]
# d = 1
# Generate data
iterationCount = 2000
true_w = np.array([1,2,3,4,5,]) # Reverse-engineer to get to this vector
d = len(true_w)
dfColNames = [f"w{s+1}" for s in range(d)]
dfColNames.append('F(w)')
points = []
for i in range(iterationCount):
x = np.random.randn(d)
y = true_w.dot(x) + np.random.randn()
points.append((x,y))
def F(w):
return sum((w.dot(x) - y)**2 for x, y in points) / len(points)
def dF(w):
return sum(2*(w.dot(x) - y) * x for x, y in points) / len(points)
##############################################
# Algorithm
def gradientDescent(F, dF, d):
w = np.zeros(d)
eta = 0.01
lst = []
for t in range(iterationCount):
l1 = []
value = F(w)
gradient = dF(w)
w = w - eta * gradient
l1.extend(w)
l1.append(value)
lst.append(l1)
df = pd.DataFrame(lst, columns = dfColNames)
df['Iteration'] = df.index
return df
result = gradientDescent(F, dF, d)
# print(result)
In [2]:
! python lec02-c02-gradientDescentVectorized.py
import plotly.express as px
import numpy as np
result1 = result.melt(id_vars=['Iteration', 'F(w)'], \
value_vars=['w1', 'w2', 'w3', 'w4', 'w5'], \
var_name='w')
# print(result1)
xMin = np.floor(min(result1['value']))
xMax = np.ceil(max(result1['value']))
yMin = np.floor(min(result1['F(w)']))
yMax = np.ceil(max(result1['F(w)']))
# #Creating animation using plotly express
fig = px.line(result1, x="value", y="F(w)",
# animation_frame="Iteration",
# animation_group="w",
# size="F(w)", # color="continent", hover_name="country",
# log_y=True, # size_max=55,
color = "w",
range_x=[xMin,xMax], range_y=[yMin,yMax],
markers=True,
)
# fig.update_traces()
fig.show()
fig.write_image("images/02_c02_gd.png")
Example - Stochastic Gradient Descent¶
In [3]:
# %load lec02-c03-stochasticGradientDescent.py
import numpy as np
##########################################################################
# Modeling: what we want to capture
# points = [(np.array([2]),4), (np.array([4]),2)]
# d = 1
# Generate artificial data
true_w = np.array([1,2,3,4,5])
d = len(true_w)
points = []
iterationCount = 500
for i in range(iterationCount):
x = np.random.randn(d)
y = true_w.dot(x) + np.random.randn()
# print(x, y)
points.append((x,y))
def F(w):
return sum((w.dot(x) - y)**2 for x, y in points) / len(points)
def dF(w):
return sum(2*(w.dot(x) - y)*x for x, y in points) / len(points)
def sF(w, i):
x,y = points[i]
return (w.dot(x) - y)**2
def sdF(w, i):
x,y = points[i]
return 2*(w.dot(x) - y)*x
##########################################################################
# Algorithms: how we compute it
def gradientDescent(F, dF, d):
# gradient descent
w = np.zeros(d)
eta = 0.01
for t in range(iterationCount):
value = F(w)
gradient = dF(w)
w = w - eta * gradient
print('iteration {}: w = {}, F(w) = {}'.format(t, w, value))
def stochasticGradientDescent(sF, sdF, d, n):
# stochastic gradient descent
w = np.zeros(d)
eta = 1
numUpdates = 0
for t in range(iterationCount):
for i in range(n):
value = sF(w, i)
gradient = sdF(w, i)
numUpdates += 1
eta = 1 / numUpdates
w = w - eta * gradient
print('iteration {}: w = {}, F(w) = {}'.format(t, w, value))
##########################################################################
# gradientDescent(F, dF, d)
stochasticGradientDescent(sF, sdF, d, len(points))
iteration 0: w = [1.11001994 1.96311751 3.04617019 4.03418469 5.05178579], F(w) = 0.3684719304237501 iteration 1: w = [1.09576148 1.9656774 3.05099849 4.03142389 5.03611595], F(w) = 0.36134339250816555 iteration 2: w = [1.092828 1.96766668 3.0504411 4.02769041 5.03085297], F(w) = 0.36473804229074586 iteration 3: w = [1.09177064 1.96884828 3.04975783 4.0252496 5.02818704], F(w) = 0.36749732881181335 iteration 4: w = [1.09128046 1.96961296 3.0492191 4.0235922 5.02657006], F(w) = 0.3694929950208076 iteration 5: w = [1.09101779 1.97014486 3.0488065 4.02240399 5.02548264], F(w) = 0.37096557212665104 iteration 6: w = [1.09086313 1.97053525 3.04848568 4.02151332 5.02470037], F(w) = 0.3720872618846346 iteration 7: w = [1.09076587 1.9708336 3.04823082 4.02082183 5.02411019], F(w) = 0.3729668536204646 iteration 8: w = [1.09070169 1.97106886 3.04802417 4.0202698 5.02364888], F(w) = 0.37367376283116605 iteration 9: w = [1.09065777 1.97125905 3.04785354 4.01981907 5.02327825], F(w) = 0.3742536860015068 iteration 10: w = [1.09062686 1.97141596 3.04771043 4.01944417 5.02297389], F(w) = 0.3747377135217631 iteration 11: w = [1.09060463 1.97154759 3.04758876 4.01912748 5.02271943], F(w) = 0.37514764965488945 iteration 12: w = [1.09058837 1.97165958 3.0474841 4.01885645 5.0225035 ], F(w) = 0.3754992028172382 iteration 13: w = [1.09057634 1.97175601 3.04739314 4.01862187 5.02231794], F(w) = 0.37580396001008004 iteration 14: w = [1.09056734 1.97183991 3.04731338 4.01841685 5.02215676], F(w) = 0.37607064695387094 iteration 15: w = [1.09056058 1.97191357 3.04724288 4.01823614 5.02201543], F(w) = 0.37630595552946555 iteration 16: w = [1.09055549 1.97197875 3.04718012 4.01807566 5.02189049], F(w) = 0.37651510127797266 iteration 17: w = [1.09055165 1.97203684 3.0471239 4.01793219 5.02177924], F(w) = 0.37670220783823855 iteration 18: w = [1.09054879 1.97208893 3.04707326 4.01780317 5.02167954], F(w) = 0.37687057763432186 iteration 19: w = [1.09054666 1.9721359 3.0470274 4.01768651 5.02158968], F(w) = 0.3770228860878547 iteration 20: w = [1.09054512 1.97217848 3.04698568 4.01758052 5.02150827], F(w) = 0.3771613233486871 iteration 21: w = [1.09054403 1.97221724 3.04694756 4.01748379 5.02143416], F(w) = 0.3772876993315733 iteration 22: w = [1.0905433 1.97225269 3.0469126 4.01739518 5.02136643], F(w) = 0.37740352265781524 iteration 23: w = [1.09054286 1.97228522 3.04688043 4.01731368 5.02130426], F(w) = 0.37751006074872345 iteration 24: w = [1.09054264 1.97231519 3.04685071 4.01723849 5.02124702], F(w) = 0.37760838611090053 iteration 25: w = [1.0905426 1.97234289 3.04682319 4.01716889 5.02119412], F(w) = 0.3776994123721696 iteration 26: w = [1.0905427 1.97236855 3.04679763 4.01710428 5.0211451 ], F(w) = 0.37778392261802085 iteration 27: w = [1.09054292 1.97239241 3.04677382 4.01704415 5.02109954], F(w) = 0.37786259187940435 iteration 28: w = [1.09054323 1.97241464 3.0467516 4.01698804 5.02105709], F(w) = 0.3779360051315021 iteration 29: w = [1.09054361 1.9724354 3.0467308 4.01693556 5.02101744], F(w) = 0.37800467181429137 iteration 30: w = [1.09054405 1.97245484 3.0467113 4.01688638 5.02098032], F(w) = 0.3780690376338688 iteration 31: w = [1.09054453 1.97247308 3.04669298 4.01684018 5.02094549], F(w) = 0.3781294942199384 iteration 32: w = [1.09054505 1.97249022 3.04667573 4.01679672 5.02091276], F(w) = 0.37818638708026203 iteration 33: w = [1.09054559 1.97250637 3.04665946 4.01675574 5.02088193], F(w) = 0.37824002219212877 iteration 34: w = [1.09054616 1.9725216 3.0466441 4.01671705 5.02085285], F(w) = 0.37829067149546175 iteration 35: w = [1.09054674 1.97253599 3.04662957 4.01668045 5.02082536], F(w) = 0.3783385774953191 iteration 36: w = [1.09054733 1.97254961 3.04661579 4.01664579 5.02079935], F(w) = 0.3783839571376096 iteration 37: w = [1.09054792 1.97256252 3.04660273 4.0166129 5.0207747 ], F(w) = 0.3784270050885211 iteration 38: w = [1.09054852 1.97257477 3.04659031 4.01658167 5.02075129], F(w) = 0.37846789652177226 iteration 39: w = [1.09054912 1.97258641 3.0465785 4.01655196 5.02072905], F(w) = 0.3785067894979352 iteration 40: w = [1.09054972 1.9725975 3.04656725 4.01652367 5.02070788], F(w) = 0.37854382700363937 iteration 41: w = [1.09055031 1.97260805 3.04655653 4.0164967 5.02068771], F(w) = 0.3785791387060789 iteration 42: w = [1.0905509 1.97261812 3.04654629 4.01647096 5.02066847], F(w) = 0.3786128424682389 iteration 43: w = [1.09055148 1.97262774 3.0465365 4.01644636 5.0206501 ], F(w) = 0.37864504566169804 iteration 44: w = [1.09055206 1.97263693 3.04652714 4.01642284 5.02063254], F(w) = 0.3786758463084287 iteration 45: w = [1.09055263 1.97264572 3.04651818 4.01640032 5.02061573], F(w) = 0.378705334076398 iteration 46: w = [1.09055319 1.97265415 3.04650959 4.01637873 5.02059963], F(w) = 0.3787335911508197 iteration 47: w = [1.09055374 1.97266222 3.04650135 4.01635803 5.0205842 ], F(w) = 0.37876069299857346 iteration 48: w = [1.09055429 1.97266997 3.04649344 4.01633816 5.0205694 ], F(w) = 0.37878670904077766 iteration 49: w = [1.09055482 1.97267741 3.04648584 4.01631907 5.02055518], F(w) = 0.3788117032462515 iteration 50: w = [1.09055535 1.97268455 3.04647853 4.01630072 5.02054151], F(w) = 0.37883573465631565 iteration 51: w = [1.09055586 1.97269143 3.0464715 4.01628305 5.02052837], F(w) = 0.3788588578502843 iteration 52: w = [1.09055637 1.97269805 3.04646473 4.01626605 5.02051572], F(w) = 0.3788811233590397 iteration 53: w = [1.09055687 1.97270442 3.0464582 4.01624966 5.02050353], F(w) = 0.3789025780335145 iteration 54: w = [1.09055736 1.97271056 3.0464519 4.01623386 5.02049178], F(w) = 0.3789232653736971 iteration 55: w = [1.09055784 1.97271649 3.04644583 4.01621861 5.02048045], F(w) = 0.3789432258228476 iteration 56: w = [1.09055831 1.97272221 3.04643997 4.01620389 5.02046952], F(w) = 0.37896249703137475 iteration 57: w = [1.09055877 1.97272773 3.0464343 4.01618967 5.02045896], F(w) = 0.37898111409376406 iteration 58: w = [1.09055922 1.97273307 3.04642882 4.01617592 5.02044875], F(w) = 0.3789991097618449 iteration 59: w = [1.09055966 1.97273822 3.04642353 4.01616263 5.02043888], F(w) = 0.37901651463701547 iteration 60: w = [1.0905601 1.97274321 3.0464184 4.01614976 5.02042934], F(w) = 0.3790333573439207 iteration 61: w = [1.09056052 1.97274804 3.04641343 4.01613731 5.02042009], F(w) = 0.37904966468739487 iteration 62: w = [1.09056094 1.97275272 3.04640863 4.01612524 5.02041114], F(w) = 0.3790654617949512 iteration 63: w = [1.09056135 1.97275725 3.04640396 4.01611354 5.02040247], F(w) = 0.37908077224585973 iteration 64: w = [1.09056175 1.97276165 3.04639944 4.0161022 5.02039407], F(w) = 0.37909561818859117 iteration 65: w = [1.09056215 1.97276591 3.04639506 4.0160912 5.02038591], F(w) = 0.37911002044772696 iteration 66: w = [1.09056253 1.97277004 3.0463908 4.01608052 5.020378 ], F(w) = 0.37912399862142343 iteration 67: w = [1.09056291 1.97277406 3.04638667 4.01607015 5.02037032], F(w) = 0.37913757117034663 iteration 68: w = [1.09056328 1.97277795 3.04638265 4.01606008 5.02036286], F(w) = 0.3791507554989948 iteration 69: w = [1.09056365 1.97278174 3.04637875 4.01605029 5.02035561], F(w) = 0.37916356803026274 iteration 70: w = [1.09056401 1.97278542 3.04637496 4.01604077 5.02034857], F(w) = 0.3791760242735714 iteration 71: w = [1.09056436 1.972789 3.04637127 4.01603152 5.02034172], F(w) = 0.3791881388875674 iteration 72: w = [1.0905647 1.97279248 3.04636768 4.01602251 5.02033505], F(w) = 0.3791999257376247 iteration 73: w = [1.09056504 1.97279587 3.04636418 4.01601375 5.02032857], F(w) = 0.3792113979488197 iteration 74: w = [1.09056537 1.97279916 3.04636078 4.01600521 5.02032225], F(w) = 0.379222567954675 iteration 75: w = [1.09056569 1.97280237 3.04635746 4.0159969 5.02031611], F(w) = 0.379233447542153 iteration 76: w = [1.09056601 1.9728055 3.04635424 4.0159888 5.02031012], F(w) = 0.37924404789302935 iteration 77: w = [1.09056633 1.97280855 3.04635109 4.0159809 5.02030428], F(w) = 0.37925437962238223 iteration 78: w = [1.09056663 1.97281152 3.04634802 4.01597321 5.02029859], F(w) = 0.3792644528139553 iteration 79: w = [1.09056694 1.97281442 3.04634502 4.0159657 5.02029304], F(w) = 0.3792742770529919 iteration 80: w = [1.09056723 1.97281724 3.0463421 4.01595838 5.02028763], F(w) = 0.37928386145669846 iteration 81: w = [1.09056752 1.97282 3.04633925 4.01595123 5.02028235], F(w) = 0.37929321470244837 iteration 82: w = [1.09056781 1.97282269 3.04633647 4.01594425 5.02027719], F(w) = 0.3793023450540098 iteration 83: w = [1.09056809 1.97282532 3.04633375 4.01593744 5.02027216], F(w) = 0.37931126038585133 iteration 84: w = [1.09056836 1.97282788 3.0463311 4.01593078 5.02026725], F(w) = 0.37931996820583913 iteration 85: w = [1.09056863 1.97283039 3.04632851 4.01592428 5.02026245], F(w) = 0.37932847567629935 iteration 86: w = [1.0905689 1.97283283 3.04632597 4.01591793 5.02025775], F(w) = 0.37933678963372147 iteration 87: w = [1.09056916 1.97283523 3.0463235 4.01591172 5.02025317], F(w) = 0.37934491660700986 iteration 88: w = [1.09056942 1.97283757 3.04632108 4.01590564 5.02024869], F(w) = 0.3793528628346459 iteration 89: w = [1.09056967 1.97283985 3.04631871 4.01589971 5.0202443 ], F(w) = 0.3793606342806174 iteration 90: w = [1.09056992 1.97284209 3.04631639 4.01589389 5.02024001], F(w) = 0.379368236649392 iteration 91: w = [1.09057016 1.97284428 3.04631412 4.01588821 5.02023582], F(w) = 0.37937567539983047 iteration 92: w = [1.0905704 1.97284642 3.0463119 4.01588265 5.02023171], F(w) = 0.37938295575829506 iteration 93: w = [1.09057064 1.97284852 3.04630973 4.0158772 5.0202277 ], F(w) = 0.37939008273091956 iteration 94: w = [1.09057087 1.97285057 3.0463076 4.01587186 5.02022376], F(w) = 0.3793970611150642 iteration 95: w = [1.0905711 1.97285258 3.04630552 4.01586664 5.02021991], F(w) = 0.3794038955100623 iteration 96: w = [1.09057132 1.97285455 3.04630348 4.01586152 5.02021613], F(w) = 0.37941059032738184 iteration 97: w = [1.09057155 1.97285648 3.04630148 4.01585651 5.02021244], F(w) = 0.37941714980005437 iteration 98: w = [1.09057176 1.97285837 3.04629952 4.0158516 5.02020881], F(w) = 0.3794235779916966 iteration 99: w = [1.09057198 1.97286022 3.0462976 4.01584678 5.02020526], F(w) = 0.3794298788048349 iteration 100: w = [1.09057219 1.97286203 3.04629571 4.01584206 5.02020178], F(w) = 0.37943605598883756 iteration 101: w = [1.09057239 1.97286381 3.04629387 4.01583743 5.02019837], F(w) = 0.3794421131473322 iteration 102: w = [1.0905726 1.97286556 3.04629206 4.01583289 5.02019502], F(w) = 0.3794480537452354 iteration 103: w = [1.0905728 1.97286727 3.04629028 4.01582843 5.02019174], F(w) = 0.3794538811153693 iteration 104: w = [1.090573 1.97286895 3.04628854 4.01582406 5.02018852], F(w) = 0.37945959846469646 iteration 105: w = [1.09057319 1.9728706 3.04628682 4.01581977 5.02018536], F(w) = 0.37946520888016216 iteration 106: w = [1.09057338 1.97287222 3.04628515 4.01581556 5.02018226], F(w) = 0.3794707153343297 iteration 107: w = [1.09057357 1.9728738 3.0462835 4.01581143 5.02017921], F(w) = 0.3794761206905905 iteration 108: w = [1.09057376 1.97287536 3.04628188 4.01580737 5.02017623], F(w) = 0.3794814277080982 iteration 109: w = [1.09057394 1.97287689 3.04628029 4.01580339 5.02017329], F(w) = 0.37948663904655616 iteration 110: w = [1.09057412 1.97287839 3.04627873 4.01579948 5.02017041], F(w) = 0.3794917572705584 iteration 111: w = [1.0905743 1.97287987 3.0462772 4.01579563 5.02016758], F(w) = 0.37949678485388805 iteration 112: w = [1.09057447 1.97288132 3.04627569 4.01579186 5.0201648 ], F(w) = 0.3795017241834364 iteration 113: w = [1.09057465 1.97288274 3.04627421 4.01578815 5.02016206], F(w) = 0.37950657756302536 iteration 114: w = [1.09057482 1.97288414 3.04627275 4.0157845 5.02015938], F(w) = 0.37951134721699226 iteration 115: w = [1.09057499 1.97288552 3.04627132 4.01578092 5.02015674], F(w) = 0.3795160352935358 iteration 116: w = [1.09057515 1.97288687 3.04626992 4.01577739 5.02015415], F(w) = 0.3795206438680206 iteration 117: w = [1.09057531 1.9728882 3.04626854 4.01577393 5.0201516 ], F(w) = 0.3795251749459798 iteration 118: w = [1.09057547 1.97288951 3.04626718 4.01577052 5.02014909], F(w) = 0.37952963046605487 iteration 119: w = [1.09057563 1.97289079 3.04626584 4.01576717 5.02014662], F(w) = 0.37953401230277223 iteration 120: w = [1.09057579 1.97289205 3.04626453 4.01576388 5.0201442 ], F(w) = 0.37953832226911566 iteration 121: w = [1.09057594 1.9728933 3.04626323 4.01576063 5.02014181], F(w) = 0.3795425621191142 iteration 122: w = [1.0905761 1.97289452 3.04626196 4.01575744 5.02013946], F(w) = 0.37954673355017654 iteration 123: w = [1.09057625 1.97289572 3.04626071 4.01575431 5.02013715], F(w) = 0.3795508382053268 iteration 124: w = [1.09057639 1.97289691 3.04625948 4.01575122 5.02013488], F(w) = 0.3795548776754288 iteration 125: w = [1.09057654 1.97289807 3.04625826 4.01574818 5.02013265], F(w) = 0.3795588535011551 iteration 126: w = [1.09057668 1.97289922 3.04625707 4.01574518 5.02013044], F(w) = 0.37956276717506715 iteration 127: w = [1.09057682 1.97290035 3.04625589 4.01574224 5.02012828], F(w) = 0.3795666201433902 iteration 128: w = [1.09057697 1.97290146 3.04625474 4.01573934 5.02012614], F(w) = 0.3795704138078176 iteration 129: w = [1.0905771 1.97290256 3.0462536 4.01573648 5.02012404], F(w) = 0.37957414952719926 iteration 130: w = [1.09057724 1.97290363 3.04625248 4.01573367 5.02012197], F(w) = 0.3795778286192451 iteration 131: w = [1.09057737 1.9729047 3.04625137 4.0157309 5.02011993], F(w) = 0.3795814523619411 iteration 132: w = [1.09057751 1.97290574 3.04625028 4.01572817 5.02011793], F(w) = 0.3795850219951133 iteration 133: w = [1.09057764 1.97290677 3.04624921 4.01572548 5.02011595], F(w) = 0.379588538721858 iteration 134: w = [1.09057777 1.97290779 3.04624815 4.01572283 5.020114 ], F(w) = 0.3795920037098476 iteration 135: w = [1.0905779 1.97290879 3.04624711 4.01572022 5.02011208], F(w) = 0.3795954180926565 iteration 136: w = [1.09057802 1.97290977 3.04624608 4.01571764 5.02011019], F(w) = 0.3795987829709613 iteration 137: w = [1.09057815 1.97291074 3.04624507 4.01571511 5.02010832], F(w) = 0.3796020994137685 iteration 138: w = [1.09057827 1.9729117 3.04624407 4.01571261 5.02010648], F(w) = 0.3796053684595041 iteration 139: w = [1.09057839 1.97291264 3.04624309 4.01571014 5.02010467], F(w) = 0.37960859111713313 iteration 140: w = [1.09057851 1.97291357 3.04624212 4.01570771 5.02010289], F(w) = 0.37961176836717736 iteration 141: w = [1.09057863 1.97291449 3.04624117 4.01570531 5.02010112], F(w) = 0.3796149011627011 iteration 142: w = [1.09057875 1.9729154 3.04624022 4.01570295 5.02009939], F(w) = 0.37961799043031286 iteration 143: w = [1.09057887 1.97291629 3.04623929 4.01570062 5.02009767], F(w) = 0.3796210370710341 iteration 144: w = [1.09057898 1.97291717 3.04623838 4.01569832 5.02009599], F(w) = 0.37962404196115557 iteration 145: w = [1.09057909 1.97291803 3.04623747 4.01569606 5.02009432], F(w) = 0.37962700595316723 iteration 146: w = [1.09057921 1.97291889 3.04623658 4.01569382 5.02009268], F(w) = 0.37962992987646466 iteration 147: w = [1.09057932 1.97291973 3.0462357 4.01569161 5.02009105], F(w) = 0.37963281453817344 iteration 148: w = [1.09057943 1.97292057 3.04623483 4.01568944 5.02008945], F(w) = 0.3796356607238837 iteration 149: w = [1.09057953 1.97292139 3.04623397 4.01568729 5.02008788], F(w) = 0.3796384691983607 iteration 150: w = [1.09057964 1.9729222 3.04623313 4.01568517 5.02008632], F(w) = 0.3796412407062665 iteration 151: w = [1.09057975 1.972923 3.04623229 4.01568308 5.02008478], F(w) = 0.3796439759727534 iteration 152: w = [1.09057985 1.97292379 3.04623147 4.01568101 5.02008326], F(w) = 0.37964667570413346 iteration 153: w = [1.09057995 1.97292457 3.04623066 4.01567897 5.02008177], F(w) = 0.37964934058849453 iteration 154: w = [1.09058005 1.97292534 3.04622985 4.01567696 5.02008029], F(w) = 0.37965197129625516 iteration 155: w = [1.09058016 1.9729261 3.04622906 4.01567497 5.02007883], F(w) = 0.37965456848074575 iteration 156: w = [1.09058026 1.97292685 3.04622828 4.01567301 5.02007739], F(w) = 0.37965713277874785 iteration 157: w = [1.09058035 1.97292759 3.04622751 4.01567108 5.02007596], F(w) = 0.3796596648110627 iteration 158: w = [1.09058045 1.97292832 3.04622674 4.01566916 5.02007456], F(w) = 0.3796621651828971 iteration 159: w = [1.09058055 1.97292904 3.04622599 4.01566727 5.02007317], F(w) = 0.37966463448444715 iteration 160: w = [1.09058064 1.97292976 3.04622525 4.01566541 5.0200718 ], F(w) = 0.3796670732913173 iteration 161: w = [1.09058074 1.97293046 3.04622451 4.01566357 5.02007045], F(w) = 0.3796694821650024 iteration 162: w = [1.09058083 1.97293116 3.04622379 4.01566175 5.02006911], F(w) = 0.3796718616532769 iteration 163: w = [1.09058092 1.97293184 3.04622307 4.01565995 5.02006779], F(w) = 0.379674212290619 iteration 164: w = [1.09058101 1.97293252 3.04622236 4.01565817 5.02006649], F(w) = 0.379676534598656 iteration 165: w = [1.0905811 1.97293319 3.04622166 4.01565642 5.0200652 ], F(w) = 0.37967882908649114 iteration 166: w = [1.09058119 1.97293386 3.04622097 4.01565468 5.02006392], F(w) = 0.37968109625111873 iteration 167: w = [1.09058128 1.97293451 3.04622028 4.01565297 5.02006266], F(w) = 0.37968333657772746 iteration 168: w = [1.09058137 1.97293516 3.04621961 4.01565127 5.02006142], F(w) = 0.37968555054012126 iteration 169: w = [1.09058146 1.9729358 3.04621894 4.0156496 5.02006019], F(w) = 0.37968773860101024 iteration 170: w = [1.09058154 1.97293643 3.04621828 4.01564795 5.02005898], F(w) = 0.3796899012123264 iteration 171: w = [1.09058163 1.97293706 3.04621763 4.01564631 5.02005778], F(w) = 0.3796920388155422 iteration 172: w = [1.09058171 1.97293767 3.04621698 4.01564469 5.02005659], F(w) = 0.3796941518420018 iteration 173: w = [1.09058179 1.97293828 3.04621635 4.0156431 5.02005542], F(w) = 0.3796962407131822 iteration 174: w = [1.09058188 1.97293889 3.04621572 4.01564152 5.02005426], F(w) = 0.37969830584097025 iteration 175: w = [1.09058196 1.97293948 3.04621509 4.01563995 5.02005311], F(w) = 0.3797003476279323 iteration 176: w = [1.09058204 1.97294007 3.04621448 4.01563841 5.02005198], F(w) = 0.3797023664675969 iteration 177: w = [1.09058212 1.97294066 3.04621387 4.01563688 5.02005085], F(w) = 0.3797043627446883 iteration 178: w = [1.0905822 1.97294123 3.04621326 4.01563537 5.02004975], F(w) = 0.3797063368353727 iteration 179: w = [1.09058227 1.9729418 3.04621267 4.01563388 5.02004865], F(w) = 0.37970828910750115 iteration 180: w = [1.09058235 1.97294237 3.04621208 4.0156324 5.02004756], F(w) = 0.37971021992085763 iteration 181: w = [1.09058243 1.97294293 3.0462115 4.01563094 5.02004649], F(w) = 0.3797121296273407 iteration 182: w = [1.0905825 1.97294348 3.04621092 4.01562949 5.02004543], F(w) = 0.379714018571206 iteration 183: w = [1.09058258 1.97294402 3.04621035 4.01562807 5.02004438], F(w) = 0.37971588708922965 iteration 184: w = [1.09058265 1.97294456 3.04620979 4.01562665 5.02004334], F(w) = 0.37971773551098453 iteration 185: w = [1.09058273 1.9729451 3.04620923 4.01562525 5.02004232], F(w) = 0.3797195641589794 iteration 186: w = [1.0905828 1.97294563 3.04620867 4.01562387 5.0200413 ], F(w) = 0.3797213733488666 iteration 187: w = [1.09058287 1.97294615 3.04620813 4.0156225 5.0200403 ], F(w) = 0.37972316338957646 iteration 188: w = [1.09058294 1.97294667 3.04620759 4.01562114 5.0200393 ], F(w) = 0.3797249345835692 iteration 189: w = [1.09058301 1.97294718 3.04620705 4.0156198 5.02003832], F(w) = 0.37972668722697783 iteration 190: w = [1.09058308 1.97294768 3.04620652 4.01561847 5.02003734], F(w) = 0.3797284216097186 iteration 191: w = [1.09058315 1.97294819 3.046206 4.01561716 5.02003638], F(w) = 0.3797301380157265 iteration 192: w = [1.09058322 1.97294868 3.04620548 4.01561586 5.02003543], F(w) = 0.3797318367230862 iteration 193: w = [1.09058329 1.97294917 3.04620497 4.01561458 5.02003448], F(w) = 0.3797335180041797 iteration 194: w = [1.09058336 1.97294966 3.04620446 4.0156133 5.02003355], F(w) = 0.37973518212578267 iteration 195: w = [1.09058343 1.97295014 3.04620396 4.01561204 5.02003262], F(w) = 0.379736829349304 iteration 196: w = [1.09058349 1.97295062 3.04620346 4.01561079 5.02003171], F(w) = 0.37973845993086003 iteration 197: w = [1.09058356 1.97295109 3.04620297 4.01560956 5.0200308 ], F(w) = 0.37974007412139726 iteration 198: w = [1.09058362 1.97295155 3.04620248 4.01560834 5.0200299 ], F(w) = 0.3797416721668572 iteration 199: w = [1.09058369 1.97295202 3.046202 4.01560712 5.02002902], F(w) = 0.3797432543082796 iteration 200: w = [1.09058375 1.97295247 3.04620152 4.01560593 5.02002814], F(w) = 0.3797448207819068 iteration 201: w = [1.09058382 1.97295293 3.04620104 4.01560474 5.02002727], F(w) = 0.3797463718193759 iteration 202: w = [1.09058388 1.97295337 3.04620058 4.01560356 5.0200264 ], F(w) = 0.37974790764775335 iteration 203: w = [1.09058394 1.97295382 3.04620011 4.0156024 5.02002555], F(w) = 0.37974942848964627 iteration 204: w = [1.090584 1.97295426 3.04619965 4.01560125 5.0200247 ], F(w) = 0.3797509345633868 iteration 205: w = [1.09058406 1.97295469 3.0461992 4.01560011 5.02002387], F(w) = 0.37975242608304804 iteration 206: w = [1.09058412 1.97295512 3.04619875 4.01559898 5.02002304], F(w) = 0.3797539032586116 iteration 207: w = [1.09058418 1.97295555 3.0461983 4.01559786 5.02002222], F(w) = 0.3797553662960375 iteration 208: w = [1.09058424 1.97295597 3.04619786 4.01559675 5.0200214 ], F(w) = 0.3797568153973353 iteration 209: w = [1.0905843 1.97295639 3.04619742 4.01559565 5.0200206 ], F(w) = 0.3797582507606977 iteration 210: w = [1.09058436 1.97295681 3.04619698 4.01559456 5.0200198 ], F(w) = 0.3797596725806129 iteration 211: w = [1.09058442 1.97295722 3.04619655 4.01559348 5.02001901], F(w) = 0.3797610810478353 iteration 212: w = [1.09058448 1.97295763 3.04619613 4.01559242 5.02001823], F(w) = 0.3797624763496336 iteration 213: w = [1.09058453 1.97295803 3.04619571 4.01559136 5.02001745], F(w) = 0.37976385866974854 iteration 214: w = [1.09058459 1.97295843 3.04619529 4.01559031 5.02001668], F(w) = 0.37976522818852687 iteration 215: w = [1.09058465 1.97295882 3.04619487 4.01558927 5.02001592], F(w) = 0.379766585082994 iteration 216: w = [1.0905847 1.97295922 3.04619446 4.01558824 5.02001516], F(w) = 0.37976792952691496 iteration 217: w = [1.09058476 1.97295961 3.04619406 4.01558722 5.02001442], F(w) = 0.37976926169089636 iteration 218: w = [1.09058481 1.97295999 3.04619365 4.01558621 5.02001368], F(w) = 0.37977058174241146 iteration 219: w = [1.09058487 1.97296037 3.04619326 4.01558521 5.02001294], F(w) = 0.3797718898459422 iteration 220: w = [1.09058492 1.97296075 3.04619286 4.01558422 5.02001221], F(w) = 0.37977318616297406 iteration 221: w = [1.09058497 1.97296113 3.04619247 4.01558324 5.02001149], F(w) = 0.37977447085212596 iteration 222: w = [1.09058503 1.9729615 3.04619208 4.01558226 5.02001078], F(w) = 0.37977574406915143 iteration 223: w = [1.09058508 1.97296187 3.04619169 4.0155813 5.02001007], F(w) = 0.37977700596704705 iteration 224: w = [1.09058513 1.97296223 3.04619131 4.01558034 5.02000937], F(w) = 0.37977825669608817 iteration 225: w = [1.09058518 1.97296259 3.04619093 4.01557939 5.02000867], F(w) = 0.3797794964039388 iteration 226: w = [1.09058523 1.97296295 3.04619056 4.01557845 5.02000798], F(w) = 0.37978072523562606 iteration 227: w = [1.09058528 1.97296331 3.04619019 4.01557752 5.0200073 ], F(w) = 0.3797819433337001 iteration 228: w = [1.09058534 1.97296366 3.04618982 4.01557659 5.02000662], F(w) = 0.379783150838165 iteration 229: w = [1.09058539 1.97296401 3.04618945 4.01557568 5.02000595], F(w) = 0.37978434788665294 iteration 230: w = [1.09058543 1.97296435 3.04618909 4.01557477 5.02000528], F(w) = 0.3797855346143747 iteration 231: w = [1.09058548 1.9729647 3.04618873 4.01557387 5.02000462], F(w) = 0.3797867111542359 iteration 232: w = [1.09058553 1.97296504 3.04618837 4.01557298 5.02000397], F(w) = 0.37978787763690564 iteration 233: w = [1.09058558 1.97296537 3.04618802 4.01557209 5.02000332], F(w) = 0.37978903419078286 iteration 234: w = [1.09058563 1.97296571 3.04618767 4.01557121 5.02000268], F(w) = 0.37979018094212413 iteration 235: w = [1.09058568 1.97296604 3.04618732 4.01557034 5.02000204], F(w) = 0.37979131801501853 iteration 236: w = [1.09058572 1.97296637 3.04618698 4.01556948 5.02000141], F(w) = 0.379792445531508 iteration 237: w = [1.09058577 1.97296669 3.04618664 4.01556862 5.02000078], F(w) = 0.37979356361156336 iteration 238: w = [1.09058582 1.97296702 3.0461863 4.01556777 5.02000016], F(w) = 0.3797946723731651 iteration 239: w = [1.09058586 1.97296734 3.04618597 4.01556693 5.01999954], F(w) = 0.3797957719323341 iteration 240: w = [1.09058591 1.97296766 3.04618563 4.0155661 5.01999893], F(w) = 0.37979686240317984 iteration 241: w = [1.09058596 1.97296797 3.0461853 4.01556527 5.01999832], F(w) = 0.37979794389792537 iteration 242: w = [1.090586 1.97296828 3.04618497 4.01556445 5.01999772], F(w) = 0.37979901652694686 iteration 243: w = [1.09058605 1.97296859 3.04618465 4.01556364 5.01999712], F(w) = 0.3798000803988337 iteration 244: w = [1.09058609 1.9729689 3.04618433 4.01556283 5.01999653], F(w) = 0.3798011356203775 iteration 245: w = [1.09058613 1.97296921 3.04618401 4.01556203 5.01999594], F(w) = 0.3798021822966959 iteration 246: w = [1.09058618 1.97296951 3.04618369 4.01556123 5.01999536], F(w) = 0.37980322053115906 iteration 247: w = [1.09058622 1.97296981 3.04618338 4.01556044 5.01999478], F(w) = 0.37980425042549487 iteration 248: w = [1.09058626 1.97297011 3.04618306 4.01555966 5.01999421], F(w) = 0.3798052720797942 iteration 249: w = [1.09058631 1.9729704 3.04618276 4.01555889 5.01999364], F(w) = 0.37980628559260193 iteration 250: w = [1.09058635 1.9729707 3.04618245 4.01555812 5.01999308], F(w) = 0.3798072910608194 iteration 251: w = [1.09058639 1.97297099 3.04618214 4.01555735 5.01999252], F(w) = 0.37980828857987087 iteration 252: w = [1.09058643 1.97297128 3.04618184 4.01555659 5.01999196], F(w) = 0.3798092782436574 iteration 253: w = [1.09058648 1.97297156 3.04618154 4.01555584 5.01999141], F(w) = 0.3798102601446193 iteration 254: w = [1.09058652 1.97297185 3.04618124 4.0155551 5.01999086], F(w) = 0.3798112343737187 iteration 255: w = [1.09058656 1.97297213 3.04618095 4.01555436 5.01999032], F(w) = 0.37981220102054003 iteration 256: w = [1.0905866 1.97297241 3.04618066 4.01555362 5.01998978], F(w) = 0.3798131601732704 iteration 257: w = [1.09058664 1.97297268 3.04618037 4.01555289 5.01998925], F(w) = 0.37981411191872266 iteration 258: w = [1.09058668 1.97297296 3.04618008 4.01555217 5.01998872], F(w) = 0.37981505634238344 iteration 259: w = [1.09058672 1.97297323 3.04617979 4.01555145 5.01998819], F(w) = 0.3798159935284241 iteration 260: w = [1.09058676 1.9729735 3.04617951 4.01555074 5.01998767], F(w) = 0.37981692355973573 iteration 261: w = [1.0905868 1.97297377 3.04617923 4.01555004 5.01998715], F(w) = 0.37981784651793804 iteration 262: w = [1.09058684 1.97297404 3.04617895 4.01554933 5.01998664], F(w) = 0.3798187624834196 iteration 263: w = [1.09058688 1.97297431 3.04617867 4.01554864 5.01998613], F(w) = 0.3798196715353676 iteration 264: w = [1.09058691 1.97297457 3.04617839 4.01554795 5.01998562], F(w) = 0.37982057375175343 iteration 265: w = [1.09058695 1.97297483 3.04617812 4.01554726 5.01998512], F(w) = 0.37982146920940074 iteration 266: w = [1.09058699 1.97297509 3.04617785 4.01554658 5.01998462], F(w) = 0.379822357983982 iteration 267: w = [1.09058703 1.97297535 3.04617758 4.01554591 5.01998413], F(w) = 0.37982324015003044 iteration 268: w = [1.09058707 1.9729756 3.04617731 4.01554524 5.01998364], F(w) = 0.3798241157810006 iteration 269: w = [1.0905871 1.97297585 3.04617705 4.01554457 5.01998315], F(w) = 0.3798249849492438 iteration 270: w = [1.09058714 1.9729761 3.04617678 4.01554391 5.01998267], F(w) = 0.37982584772605443 iteration 271: w = [1.09058718 1.97297635 3.04617652 4.01554326 5.01998219], F(w) = 0.379826704181673 iteration 272: w = [1.09058721 1.9729766 3.04617626 4.0155426 5.01998171], F(w) = 0.37982755438533017 iteration 273: w = [1.09058725 1.97297685 3.046176 4.01554196 5.01998124], F(w) = 0.3798283984052201 iteration 274: w = [1.09058728 1.97297709 3.04617575 4.01554132 5.01998077], F(w) = 0.3798292363085688 iteration 275: w = [1.09058732 1.97297733 3.04617549 4.01554068 5.0199803 ], F(w) = 0.37983006816164233 iteration 276: w = [1.09058736 1.97297758 3.04617524 4.01554005 5.01997984], F(w) = 0.3798308940297451 iteration 277: w = [1.09058739 1.97297781 3.04617499 4.01553942 5.01997938], F(w) = 0.3798317139772371 iteration 278: w = [1.09058743 1.97297805 3.04617474 4.0155388 5.01997892], F(w) = 0.3798325280675579 iteration 279: w = [1.09058746 1.97297829 3.0461745 4.01553818 5.01997847], F(w) = 0.3798333363632532 iteration 280: w = [1.0905875 1.97297852 3.04617425 4.01553756 5.01997802], F(w) = 0.3798341389259582 iteration 281: w = [1.09058753 1.97297875 3.04617401 4.01553695 5.01997757], F(w) = 0.3798349358164654 iteration 282: w = [1.09058756 1.97297898 3.04617377 4.01553635 5.01997712], F(w) = 0.3798357270947128 iteration 283: w = [1.0905876 1.97297921 3.04617353 4.01553575 5.01997668], F(w) = 0.37983651281978265 iteration 284: w = [1.09058763 1.97297944 3.04617329 4.01553515 5.01997625], F(w) = 0.3798372930499232 iteration 285: w = [1.09058766 1.97297967 3.04617305 4.01553456 5.01997581], F(w) = 0.37983806784258733 iteration 286: w = [1.0905877 1.97297989 3.04617282 4.01553397 5.01997538], F(w) = 0.37983883725442563 iteration 287: w = [1.09058773 1.97298011 3.04617258 4.01553338 5.01997495], F(w) = 0.37983960134130423 iteration 288: w = [1.09058776 1.97298033 3.04617235 4.0155328 5.01997453], F(w) = 0.3798403601583056 iteration 289: w = [1.0905878 1.97298055 3.04617212 4.01553222 5.0199741 ], F(w) = 0.37984111375977353 iteration 290: w = [1.09058783 1.97298077 3.04617189 4.01553165 5.01997368], F(w) = 0.3798418621992925 iteration 291: w = [1.09058786 1.97298099 3.04617167 4.01553108 5.01997327], F(w) = 0.3798426055297236 iteration 292: w = [1.09058789 1.9729812 3.04617144 4.01553052 5.01997285], F(w) = 0.3798433438032209 iteration 293: w = [1.09058792 1.97298142 3.04617122 4.01552996 5.01997244], F(w) = 0.3798440770712075 iteration 294: w = [1.09058795 1.97298163 3.04617099 4.0155294 5.01997203], F(w) = 0.37984480538441384 iteration 295: w = [1.09058799 1.97298184 3.04617077 4.01552884 5.01997163], F(w) = 0.37984552879289296 iteration 296: w = [1.09058802 1.97298205 3.04617055 4.01552829 5.01997122], F(w) = 0.3798462473460358 iteration 297: w = [1.09058805 1.97298226 3.04617034 4.01552775 5.01997082], F(w) = 0.3798469610925679 iteration 298: w = [1.09058808 1.97298246 3.04617012 4.0155272 5.01997043], F(w) = 0.3798476700805605 iteration 299: w = [1.09058811 1.97298267 3.04616991 4.01552667 5.01997003], F(w) = 0.3798483743574259 iteration 300: w = [1.09058814 1.97298287 3.04616969 4.01552613 5.01996964], F(w) = 0.37984907396999446 iteration 301: w = [1.09058817 1.97298307 3.04616948 4.0155256 5.01996925], F(w) = 0.379849768964456 iteration 302: w = [1.0905882 1.97298327 3.04616927 4.01552507 5.01996886], F(w) = 0.379850459386367 iteration 303: w = [1.09058823 1.97298347 3.04616906 4.01552454 5.01996848], F(w) = 0.3798511452807148 iteration 304: w = [1.09058826 1.97298367 3.04616885 4.01552402 5.0199681 ], F(w) = 0.3798518266919033 iteration 305: w = [1.09058829 1.97298387 3.04616864 4.0155235 5.01996772], F(w) = 0.3798525036637523 iteration 306: w = [1.09058832 1.97298407 3.04616844 4.01552299 5.01996734], F(w) = 0.3798531762394762 iteration 307: w = [1.09058835 1.97298426 3.04616824 4.01552248 5.01996696], F(w) = 0.3798538444617947 iteration 308: w = [1.09058838 1.97298445 3.04616803 4.01552197 5.01996659], F(w) = 0.3798545083728215 iteration 309: w = [1.0905884 1.97298465 3.04616783 4.01552146 5.01996622], F(w) = 0.37985516801415564 iteration 310: w = [1.09058843 1.97298484 3.04616763 4.01552096 5.01996585], F(w) = 0.3798558234268558 iteration 311: w = [1.09058846 1.97298503 3.04616743 4.01552046 5.01996549], F(w) = 0.3798564746514552 iteration 312: w = [1.09058849 1.97298521 3.04616723 4.01551997 5.01996513], F(w) = 0.37985712172797387 iteration 313: w = [1.09058852 1.9729854 3.04616704 4.01551948 5.01996477], F(w) = 0.3798577646959207 iteration 314: w = [1.09058855 1.97298559 3.04616684 4.01551899 5.01996441], F(w) = 0.379858403594299 iteration 315: w = [1.09058857 1.97298577 3.04616665 4.0155185 5.01996405], F(w) = 0.37985903846164926 iteration 316: w = [1.0905886 1.97298596 3.04616646 4.01551802 5.0199637 ], F(w) = 0.3798596693359669 iteration 317: w = [1.09058863 1.97298614 3.04616627 4.01551754 5.01996335], F(w) = 0.3798602962548248 iteration 318: w = [1.09058865 1.97298632 3.04616607 4.01551706 5.019963 ], F(w) = 0.37986091925531995 iteration 319: w = [1.09058868 1.9729865 3.04616589 4.01551659 5.01996265], F(w) = 0.3798615383740721 iteration 320: w = [1.09058871 1.97298668 3.0461657 4.01551611 5.0199623 ], F(w) = 0.37986215364725123 iteration 321: w = [1.09058874 1.97298686 3.04616551 4.01551565 5.01996196], F(w) = 0.3798627651105786 iteration 322: w = [1.09058876 1.97298703 3.04616533 4.01551518 5.01996162], F(w) = 0.37986337279932564 iteration 323: w = [1.09058879 1.97298721 3.04616514 4.01551472 5.01996128], F(w) = 0.37986397674833816 iteration 324: w = [1.09058881 1.97298739 3.04616496 4.01551426 5.01996095], F(w) = 0.37986457699205267 iteration 325: w = [1.09058884 1.97298756 3.04616478 4.0155138 5.01996061], F(w) = 0.3798651735644349 iteration 326: w = [1.09058887 1.97298773 3.04616459 4.01551335 5.01996028], F(w) = 0.3798657664991017 iteration 327: w = [1.09058889 1.9729879 3.04616441 4.0155129 5.01995995], F(w) = 0.3798663558291914 iteration 328: w = [1.09058892 1.97298807 3.04616424 4.01551245 5.01995962], F(w) = 0.3798669415875067 iteration 329: w = [1.09058894 1.97298824 3.04616406 4.015512 5.01995929], F(w) = 0.37986752380641553 iteration 330: w = [1.09058897 1.97298841 3.04616388 4.01551156 5.01995897], F(w) = 0.37986810251788866 iteration 331: w = [1.09058899 1.97298858 3.04616371 4.01551112 5.01995865], F(w) = 0.37986867775355426 iteration 332: w = [1.09058902 1.97298875 3.04616353 4.01551068 5.01995833], F(w) = 0.3798692495445984 iteration 333: w = [1.09058904 1.97298891 3.04616336 4.01551025 5.01995801], F(w) = 0.37986981792190294 iteration 334: w = [1.09058907 1.97298908 3.04616319 4.01550981 5.01995769], F(w) = 0.37987038291592384 iteration 335: w = [1.09058909 1.97298924 3.04616301 4.01550938 5.01995737], F(w) = 0.3798709445568032 iteration 336: w = [1.09058912 1.9729894 3.04616284 4.01550896 5.01995706], F(w) = 0.37987150287430754 iteration 337: w = [1.09058914 1.97298956 3.04616267 4.01550853 5.01995675], F(w) = 0.37987205789784234 iteration 338: w = [1.09058917 1.97298972 3.04616251 4.01550811 5.01995644], F(w) = 0.37987260965647374 iteration 339: w = [1.09058919 1.97298988 3.04616234 4.01550769 5.01995613], F(w) = 0.3798731581789242 iteration 340: w = [1.09058921 1.97299004 3.04616217 4.01550727 5.01995583], F(w) = 0.37987370349359345 iteration 341: w = [1.09058924 1.9729902 3.04616201 4.01550686 5.01995552], F(w) = 0.37987424562854294 iteration 342: w = [1.09058926 1.97299036 3.04616184 4.01550644 5.01995522], F(w) = 0.37987478461148166 iteration 343: w = [1.09058929 1.97299051 3.04616168 4.01550603 5.01995492], F(w) = 0.3798753204698277 iteration 344: w = [1.09058931 1.97299067 3.04616151 4.01550562 5.01995462], F(w) = 0.37987585323068584 iteration 345: w = [1.09058933 1.97299082 3.04616135 4.01550522 5.01995433], F(w) = 0.37987638292084147 iteration 346: w = [1.09058936 1.97299097 3.04616119 4.01550482 5.01995403], F(w) = 0.3798769095667517 iteration 347: w = [1.09058938 1.97299113 3.04616103 4.01550441 5.01995374], F(w) = 0.3798774331946086 iteration 348: w = [1.0905894 1.97299128 3.04616087 4.01550402 5.01995344], F(w) = 0.3798779538302531 iteration 349: w = [1.09058942 1.97299143 3.04616072 4.01550362 5.01995315], F(w) = 0.3798784714992742 iteration 350: w = [1.09058945 1.97299158 3.04616056 4.01550323 5.01995287], F(w) = 0.3798789862269623 iteration 351: w = [1.09058947 1.97299173 3.0461604 4.01550283 5.01995258], F(w) = 0.3798794980383342 iteration 352: w = [1.09058949 1.97299188 3.04616025 4.01550244 5.01995229], F(w) = 0.3798800069580936 iteration 353: w = [1.09058951 1.97299202 3.04616009 4.01550206 5.01995201], F(w) = 0.37988051301065073 iteration 354: w = [1.09058954 1.97299217 3.04615994 4.01550167 5.01995173], F(w) = 0.37988101622021153 iteration 355: w = [1.09058956 1.97299232 3.04615979 4.01550129 5.01995145], F(w) = 0.3798815166106456 iteration 356: w = [1.09058958 1.97299246 3.04615963 4.01550091 5.01995117], F(w) = 0.379882014205582 iteration 357: w = [1.0905896 1.9729926 3.04615948 4.01550053 5.01995089], F(w) = 0.37988250902838255 iteration 358: w = [1.09058962 1.97299275 3.04615933 4.01550015 5.01995061], F(w) = 0.3798830011021476 iteration 359: w = [1.09058965 1.97299289 3.04615918 4.01549978 5.01995034], F(w) = 0.37988349044972247 iteration 360: w = [1.09058967 1.97299303 3.04615903 4.0154994 5.01995007], F(w) = 0.3798839770937073 iteration 361: w = [1.09058969 1.97299317 3.04615889 4.01549903 5.0199498 ], F(w) = 0.37988446105646034 iteration 362: w = [1.09058971 1.97299331 3.04615874 4.01549866 5.01994953], F(w) = 0.3798849423600532 iteration 363: w = [1.09058973 1.97299345 3.04615859 4.0154983 5.01994926], F(w) = 0.37988542102637346 iteration 364: w = [1.09058975 1.97299359 3.04615845 4.01549793 5.01994899], F(w) = 0.3798858970770111 iteration 365: w = [1.09058977 1.97299373 3.0461583 4.01549757 5.01994873], F(w) = 0.3798863705333678 iteration 366: w = [1.09058979 1.97299387 3.04615816 4.01549721 5.01994846], F(w) = 0.37988684141658924 iteration 367: w = [1.09058981 1.972994 3.04615802 4.01549685 5.0199482 ], F(w) = 0.37988730974760637 iteration 368: w = [1.09058984 1.97299414 3.04615787 4.01549649 5.01994794], F(w) = 0.37988777554708986 iteration 369: w = [1.09058986 1.97299427 3.04615773 4.01549614 5.01994768], F(w) = 0.37988823883552203 iteration 370: w = [1.09058988 1.97299441 3.04615759 4.01549579 5.01994742], F(w) = 0.379888699633151 iteration 371: w = [1.0905899 1.97299454 3.04615745 4.01549544 5.01994716], F(w) = 0.37988915796002787 iteration 372: w = [1.09058992 1.97299467 3.04615731 4.01549509 5.01994691], F(w) = 0.37988961383594877 iteration 373: w = [1.09058994 1.9729948 3.04615717 4.01549474 5.01994665], F(w) = 0.3798900672805543 iteration 374: w = [1.09058996 1.97299493 3.04615704 4.01549439 5.0199464 ], F(w) = 0.37989051831322146 iteration 375: w = [1.09058998 1.97299507 3.0461569 4.01549405 5.01994615], F(w) = 0.3798909669531509 iteration 376: w = [1.09059 1.9729952 3.04615676 4.01549371 5.0199459 ], F(w) = 0.37989141321932546 iteration 377: w = [1.09059002 1.97299532 3.04615663 4.01549337 5.01994565], F(w) = 0.379891857130542 iteration 378: w = [1.09059004 1.97299545 3.04615649 4.01549303 5.0199454 ], F(w) = 0.3798922987053993 iteration 379: w = [1.09059006 1.97299558 3.04615636 4.01549269 5.01994516], F(w) = 0.3798927379622957 iteration 380: w = [1.09059008 1.97299571 3.04615623 4.01549236 5.01994491], F(w) = 0.37989317491942826 iteration 381: w = [1.09059009 1.97299583 3.04615609 4.01549203 5.01994467], F(w) = 0.37989360959481666 iteration 382: w = [1.09059011 1.97299596 3.04615596 4.0154917 5.01994442], F(w) = 0.37989404200628146 iteration 383: w = [1.09059013 1.97299609 3.04615583 4.01549137 5.01994418], F(w) = 0.3798944721714692 iteration 384: w = [1.09059015 1.97299621 3.0461557 4.01549104 5.01994394], F(w) = 0.37989490010783805 iteration 385: w = [1.09059017 1.97299633 3.04615557 4.01549071 5.0199437 ], F(w) = 0.3798953258326646 iteration 386: w = [1.09059019 1.97299646 3.04615544 4.01549039 5.01994347], F(w) = 0.37989574936303827 iteration 387: w = [1.09059021 1.97299658 3.04615531 4.01549007 5.01994323], F(w) = 0.37989617071591264 iteration 388: w = [1.09059023 1.9729967 3.04615518 4.01548974 5.019943 ], F(w) = 0.3798965899080116 iteration 389: w = [1.09059025 1.97299682 3.04615506 4.01548942 5.01994276], F(w) = 0.37989700695592876 iteration 390: w = [1.09059026 1.97299694 3.04615493 4.01548911 5.01994253], F(w) = 0.37989742187606934 iteration 391: w = [1.09059028 1.97299706 3.0461548 4.01548879 5.0199423 ], F(w) = 0.3798978346846844 iteration 392: w = [1.0905903 1.97299718 3.04615468 4.01548848 5.01994207], F(w) = 0.3798982453978553 iteration 393: w = [1.09059032 1.9729973 3.04615455 4.01548816 5.01994184], F(w) = 0.3798986540314838 iteration 394: w = [1.09059034 1.97299742 3.04615443 4.01548785 5.01994161], F(w) = 0.37989906060132406 iteration 395: w = [1.09059036 1.97299754 3.0461543 4.01548754 5.01994138], F(w) = 0.3798994651229944 iteration 396: w = [1.09059037 1.97299765 3.04615418 4.01548723 5.01994116], F(w) = 0.37989986761191064 iteration 397: w = [1.09059039 1.97299777 3.04615406 4.01548693 5.01994093], F(w) = 0.37990026808336724 iteration 398: w = [1.09059041 1.97299789 3.04615394 4.01548662 5.01994071], F(w) = 0.37990066655250965 iteration 399: w = [1.09059043 1.972998 3.04615382 4.01548632 5.01994049], F(w) = 0.37990106303429083 iteration 400: w = [1.09059044 1.97299812 3.0461537 4.01548602 5.01994027], F(w) = 0.37990145754355087 iteration 401: w = [1.09059046 1.97299823 3.04615358 4.01548572 5.01994005], F(w) = 0.37990185009495914 iteration 402: w = [1.09059048 1.97299834 3.04615346 4.01548542 5.01993983], F(w) = 0.37990224070308554 iteration 403: w = [1.0905905 1.97299846 3.04615334 4.01548512 5.01993961], F(w) = 0.37990262938232683 iteration 404: w = [1.09059051 1.97299857 3.04615322 4.01548482 5.01993939], F(w) = 0.3799030161469113 iteration 405: w = [1.09059053 1.97299868 3.0461531 4.01548453 5.01993918], F(w) = 0.37990340101096554 iteration 406: w = [1.09059055 1.97299879 3.04615299 4.01548423 5.01993896], F(w) = 0.3799037839884584 iteration 407: w = [1.09059056 1.9729989 3.04615287 4.01548394 5.01993875], F(w) = 0.3799041650932417 iteration 408: w = [1.09059058 1.97299901 3.04615275 4.01548365 5.01993854], F(w) = 0.37990454433900844 iteration 409: w = [1.0905906 1.97299912 3.04615264 4.01548336 5.01993833], F(w) = 0.37990492173932033 iteration 410: w = [1.09059062 1.97299923 3.04615252 4.01548308 5.01993811], F(w) = 0.379905297307633 iteration 411: w = [1.09059063 1.97299934 3.04615241 4.01548279 5.01993791], F(w) = 0.37990567105724876 iteration 412: w = [1.09059065 1.97299945 3.0461523 4.0154825 5.0199377 ], F(w) = 0.37990604300135056 iteration 413: w = [1.09059067 1.97299956 3.04615218 4.01548222 5.01993749], F(w) = 0.37990641315298246 iteration 414: w = [1.09059068 1.97299967 3.04615207 4.01548194 5.01993728], F(w) = 0.3799067815250669 iteration 415: w = [1.0905907 1.97299977 3.04615196 4.01548166 5.01993708], F(w) = 0.37990714813042137 iteration 416: w = [1.09059071 1.97299988 3.04615185 4.01548138 5.01993687], F(w) = 0.3799075129817089 iteration 417: w = [1.09059073 1.97299998 3.04615174 4.0154811 5.01993667], F(w) = 0.3799078760915171 iteration 418: w = [1.09059075 1.97300009 3.04615163 4.01548082 5.01993647], F(w) = 0.3799082374722574 iteration 419: w = [1.09059076 1.97300019 3.04615152 4.01548055 5.01993627], F(w) = 0.3799085971362611 iteration 420: w = [1.09059078 1.9730003 3.04615141 4.01548027 5.01993606], F(w) = 0.3799089550957393 iteration 421: w = [1.0905908 1.9730004 3.0461513 4.01548 5.01993586], F(w) = 0.37990931136278705 iteration 422: w = [1.09059081 1.9730005 3.04615119 4.01547973 5.01993567], F(w) = 0.3799096659493592 iteration 423: w = [1.09059083 1.97300061 3.04615108 4.01547946 5.01993547], F(w) = 0.37991001886733416 iteration 424: w = [1.09059084 1.97300071 3.04615097 4.01547919 5.01993527], F(w) = 0.3799103701284522 iteration 425: w = [1.09059086 1.97300081 3.04615087 4.01547892 5.01993508], F(w) = 0.379910719744352 iteration 426: w = [1.09059087 1.97300091 3.04615076 4.01547866 5.01993488], F(w) = 0.3799110677265866 iteration 427: w = [1.09059089 1.97300101 3.04615066 4.01547839 5.01993469], F(w) = 0.3799114140865704 iteration 428: w = [1.09059091 1.97300111 3.04615055 4.01547813 5.01993449], F(w) = 0.37991175883561246 iteration 429: w = [1.09059092 1.97300121 3.04615045 4.01547786 5.0199343 ], F(w) = 0.37991210198492664 iteration 430: w = [1.09059094 1.97300131 3.04615034 4.0154776 5.01993411], F(w) = 0.3799124435456174 iteration 431: w = [1.09059095 1.97300141 3.04615024 4.01547734 5.01993392], F(w) = 0.37991278352870705 iteration 432: w = [1.09059097 1.97300151 3.04615013 4.01547708 5.01993373], F(w) = 0.37991312194509863 iteration 433: w = [1.09059098 1.97300161 3.04615003 4.01547682 5.01993354], F(w) = 0.3799134588056022 iteration 434: w = [1.090591 1.9730017 3.04614993 4.01547657 5.01993335], F(w) = 0.3799137941209182 iteration 435: w = [1.09059101 1.9730018 3.04614983 4.01547631 5.01993316], F(w) = 0.3799141279016443 iteration 436: w = [1.09059103 1.9730019 3.04614973 4.01547606 5.01993298], F(w) = 0.37991446015829616 iteration 437: w = [1.09059104 1.97300199 3.04614962 4.0154758 5.01993279], F(w) = 0.3799147909012896 iteration 438: w = [1.09059106 1.97300209 3.04614952 4.01547555 5.01993261], F(w) = 0.3799151201409607 iteration 439: w = [1.09059107 1.97300219 3.04614942 4.0154753 5.01993243], F(w) = 0.3799154478875185 iteration 440: w = [1.09059109 1.97300228 3.04614932 4.01547505 5.01993224], F(w) = 0.3799157741511065 iteration 441: w = [1.0905911 1.97300238 3.04614922 4.0154748 5.01993206], F(w) = 0.37991609894176953 iteration 442: w = [1.09059111 1.97300247 3.04614913 4.01547455 5.01993188], F(w) = 0.37991642226944516 iteration 443: w = [1.09059113 1.97300256 3.04614903 4.01547431 5.0199317 ], F(w) = 0.3799167441440141 iteration 444: w = [1.09059114 1.97300266 3.04614893 4.01547406 5.01993152], F(w) = 0.37991706457523444 iteration 445: w = [1.09059116 1.97300275 3.04614883 4.01547382 5.01993134], F(w) = 0.3799173835728107 iteration 446: w = [1.09059117 1.97300284 3.04614874 4.01547357 5.01993116], F(w) = 0.3799177011463313 iteration 447: w = [1.09059119 1.97300293 3.04614864 4.01547333 5.01993098], F(w) = 0.3799180173053167 iteration 448: w = [1.0905912 1.97300302 3.04614854 4.01547309 5.01993081], F(w) = 0.37991833205919573 iteration 449: w = [1.09059122 1.97300312 3.04614845 4.01547285 5.01993063], F(w) = 0.3799186454173049 iteration 450: w = [1.09059123 1.97300321 3.04614835 4.01547261 5.01993046], F(w) = 0.3799189573889186 iteration 451: w = [1.09059124 1.9730033 3.04614826 4.01547237 5.01993028], F(w) = 0.3799192679832378 iteration 452: w = [1.09059126 1.97300339 3.04614816 4.01547214 5.01993011], F(w) = 0.3799195772093341 iteration 453: w = [1.09059127 1.97300348 3.04614807 4.0154719 5.01992994], F(w) = 0.3799198850762533 iteration 454: w = [1.09059128 1.97300356 3.04614798 4.01547167 5.01992977], F(w) = 0.37992019159292134 iteration 455: w = [1.0905913 1.97300365 3.04614788 4.01547143 5.0199296 ], F(w) = 0.3799204967681968 iteration 456: w = [1.09059131 1.97300374 3.04614779 4.0154712 5.01992942], F(w) = 0.3799208006108776 iteration 457: w = [1.09059133 1.97300383 3.0461477 4.01547097 5.01992926], F(w) = 0.37992110312967553 iteration 458: w = [1.09059134 1.97300392 3.0461476 4.01547074 5.01992909], F(w) = 0.37992140433321797 iteration 459: w = [1.09059135 1.973004 3.04614751 4.01547051 5.01992892], F(w) = 0.37992170423006766 iteration 460: w = [1.09059137 1.97300409 3.04614742 4.01547028 5.01992875], F(w) = 0.379922002828701 iteration 461: w = [1.09059138 1.97300418 3.04614733 4.01547005 5.01992858], F(w) = 0.37992230013754824 iteration 462: w = [1.09059139 1.97300426 3.04614724 4.01546982 5.01992842], F(w) = 0.37992259616493695 iteration 463: w = [1.09059141 1.97300435 3.04614715 4.0154696 5.01992825], F(w) = 0.37992289091912557 iteration 464: w = [1.09059142 1.97300443 3.04614706 4.01546937 5.01992809], F(w) = 0.37992318440831124 iteration 465: w = [1.09059143 1.97300452 3.04614697 4.01546915 5.01992792], F(w) = 0.37992347664064857 iteration 466: w = [1.09059145 1.9730046 3.04614688 4.01546893 5.01992776], F(w) = 0.3799237676241541 iteration 467: w = [1.09059146 1.97300469 3.04614679 4.01546871 5.0199276 ], F(w) = 0.3799240573668521 iteration 468: w = [1.09059147 1.97300477 3.04614671 4.01546848 5.01992744], F(w) = 0.379924345876654 iteration 469: w = [1.09059149 1.97300486 3.04614662 4.01546826 5.01992728], F(w) = 0.3799246331614035 iteration 470: w = [1.0905915 1.97300494 3.04614653 4.01546805 5.01992712], F(w) = 0.3799249192288874 iteration 471: w = [1.09059151 1.97300502 3.04614644 4.01546783 5.01992696], F(w) = 0.3799252040868386 iteration 472: w = [1.09059152 1.9730051 3.04614636 4.01546761 5.0199268 ], F(w) = 0.37992548774290275 iteration 473: w = [1.09059154 1.97300519 3.04614627 4.01546739 5.01992664], F(w) = 0.37992577020467494 iteration 474: w = [1.09059155 1.97300527 3.04614619 4.01546718 5.01992648], F(w) = 0.3799260514796825 iteration 475: w = [1.09059156 1.97300535 3.0461461 4.01546696 5.01992632], F(w) = 0.3799263315753925 iteration 476: w = [1.09059158 1.97300543 3.04614601 4.01546675 5.01992617], F(w) = 0.37992661049919324 iteration 477: w = [1.09059159 1.97300551 3.04614593 4.01546654 5.01992601], F(w) = 0.3799268882584226 iteration 478: w = [1.0905916 1.97300559 3.04614585 4.01546632 5.01992586], F(w) = 0.37992716486037253 iteration 479: w = [1.09059161 1.97300567 3.04614576 4.01546611 5.0199257 ], F(w) = 0.37992744031225295 iteration 480: w = [1.09059163 1.97300575 3.04614568 4.0154659 5.01992555], F(w) = 0.37992771462122765 iteration 481: w = [1.09059164 1.97300583 3.04614559 4.01546569 5.0199254 ], F(w) = 0.37992798779439485 iteration 482: w = [1.09059165 1.97300591 3.04614551 4.01546549 5.01992524], F(w) = 0.3799282598387926 iteration 483: w = [1.09059166 1.97300599 3.04614543 4.01546528 5.01992509], F(w) = 0.37992853076141064 iteration 484: w = [1.09059167 1.97300607 3.04614535 4.01546507 5.01992494], F(w) = 0.37992880056915784 iteration 485: w = [1.09059169 1.97300615 3.04614526 4.01546487 5.01992479], F(w) = 0.3799290692689091 iteration 486: w = [1.0905917 1.97300622 3.04614518 4.01546466 5.01992464], F(w) = 0.3799293368674857 iteration 487: w = [1.09059171 1.9730063 3.0461451 4.01546446 5.01992449], F(w) = 0.37992960337162457 iteration 488: w = [1.09059172 1.97300638 3.04614502 4.01546425 5.01992434], F(w) = 0.37992986878805396 iteration 489: w = [1.09059173 1.97300645 3.04614494 4.01546405 5.01992419], F(w) = 0.37993013312340684 iteration 490: w = [1.09059175 1.97300653 3.04614486 4.01546385 5.01992405], F(w) = 0.37993039638427234 iteration 491: w = [1.09059176 1.97300661 3.04614478 4.01546365 5.0199239 ], F(w) = 0.37993065857717845 iteration 492: w = [1.09059177 1.97300668 3.0461447 4.01546345 5.01992375], F(w) = 0.37993091970861465 iteration 493: w = [1.09059178 1.97300676 3.04614462 4.01546325 5.01992361], F(w) = 0.3799311797850334 iteration 494: w = [1.09059179 1.97300683 3.04614454 4.01546305 5.01992346], F(w) = 0.379931438812806 iteration 495: w = [1.09059181 1.97300691 3.04614446 4.01546285 5.01992332], F(w) = 0.3799316967982513 iteration 496: w = [1.09059182 1.97300698 3.04614438 4.01546266 5.01992317], F(w) = 0.37993195374766947 iteration 497: w = [1.09059183 1.97300706 3.0461443 4.01546246 5.01992303], F(w) = 0.37993220966727864 iteration 498: w = [1.09059184 1.97300713 3.04614423 4.01546227 5.01992289], F(w) = 0.3799324645632477 iteration 499: w = [1.09059185 1.97300721 3.04614415 4.01546207 5.01992275], F(w) = 0.3799327184417104
In [4]:
!python lec02-c03-stochasticGradientDescent.py
iteration 0: w = [0.96444359 1.98994283 3.00645067 4.04896338 4.98754456], F(w) = 0.59439965588068 iteration 1: w = [0.98328616 1.98515179 2.96430196 4.00661396 4.97051553], F(w) = 0.7175819837032674 iteration 2: w = [0.9892486 1.98540868 2.95544768 3.9979082 4.96791458], F(w) = 0.7483195705831317 iteration 3: w = [0.99215414 1.9859499 2.95205225 3.99466281 4.96709854], F(w) = 0.7610105835953699 iteration 4: w = [0.99387212 1.98641913 2.95035728 3.99308843 4.96674539], F(w) = 0.7676457763483975 iteration 5: w = [0.99500689 1.98679593 2.94937378 3.99219999 4.96656108], F(w) = 0.7716265705849915 iteration 6: w = [0.99581237 1.98709786 2.94874457 3.99164663 4.96645224], F(w) = 0.7742403048073606 iteration 7: w = [0.99641378 1.98734291 2.94831347 3.99127713 4.96638206], F(w) = 0.776069290293421 iteration 8: w = [0.99687999 1.98754487 2.94800272 3.99101727 4.96633374], F(w) = 0.7774111677361473 iteration 9: w = [0.99725203 1.98771377 2.9477698 3.99082704 4.96629875], F(w) = 0.7784322926410023 iteration 10: w = [0.99755582 1.98785693 2.94758972 3.99068327 4.96627237], F(w) = 0.7792322184103221 iteration 11: w = [0.99780858 1.98797972 2.94744694 3.99057175 4.96625183], F(w) = 0.7798738271166543 iteration 12: w = [0.99802218 1.98808612 2.94733136 3.99048334 4.96623541], F(w) = 0.7803986151485137 iteration 13: w = [0.99820508 1.98817919 2.94723614 3.99041196 4.96622199], F(w) = 0.7808349763435384 iteration 14: w = [0.99836346 1.98826127 2.94715651 3.99035342 4.96621081], F(w) = 0.7812029402251881 iteration 15: w = [0.99850194 1.98833418 2.94708907 3.99030476 4.96620136], F(w) = 0.7815170080025006 iteration 16: w = [0.99862406 1.98839936 2.9470313 3.99026383 4.96619325], F(w) = 0.7817879165804269 iteration 17: w = [0.99873255 1.98845799 2.94698132 3.99022904 4.96618622], F(w) = 0.7820237727047754 iteration 18: w = [0.99882958 1.98851099 2.94693771 3.99019919 4.96618005], F(w) = 0.782230803437043 iteration 19: w = [0.99891687 1.98855914 2.94689936 3.99017338 4.96617461], F(w) = 0.7824138654582486 iteration 20: w = [0.99899583 1.98860307 2.9468654 3.99015087 4.96616975], F(w) = 0.7825767985210252 iteration 21: w = [0.99906759 1.98864332 2.94683514 3.99013113 4.96616539], F(w) = 0.7827226756807809 iteration 22: w = [0.99913309 1.98868033 2.94680802 3.9901137 4.96616146], F(w) = 0.7828539836462732 iteration 23: w = [0.99919312 1.98871447 2.9467836 3.99009823 4.96615789], F(w) = 0.7829727548793696 iteration 24: w = [0.99924834 1.98874606 2.94676149 3.99008443 4.96615463], F(w) = 0.7830806657782517 iteration 25: w = [0.9992993 1.98877538 2.9467414 3.99007205 4.96615164], F(w) = 0.7831791106313648 iteration 26: w = [0.99934648 1.98880267 2.94672306 3.99006091 4.9661489 ], F(w) = 0.7832692580041003 iteration 27: w = [0.99939029 1.98882813 2.94670627 3.99005084 4.96614636], F(w) = 0.7833520942153592 iteration 28: w = [0.99943107 1.98885193 2.94669084 3.9900417 4.966144 ], F(w) = 0.7834284572071707 iteration 29: w = [0.99946912 1.98887424 2.94667661 3.99003338 4.96614181], F(w) = 0.7834990631830139 iteration 30: w = [0.99950472 1.98889519 2.94666346 3.99002578 4.96613977], F(w) = 0.7835645277447105 iteration 31: w = [0.9995381 1.9889149 2.94665126 3.99001882 4.96613787], F(w) = 0.7836253828024351 iteration 32: w = [0.99956944 1.98893348 2.94663993 3.99001242 4.96613608], F(w) = 0.7836820902071909 iteration 33: w = [0.99959894 1.98895102 2.94662937 3.99000653 4.9661344 ], F(w) = 0.7837350528198176 iteration 34: w = [0.99962676 1.98896761 2.94661951 3.99000109 4.96613281], F(w) = 0.7837846235591048 iteration 35: w = [0.99965303 1.98898332 2.94661028 3.98999605 4.96613132], F(w) = 0.7838311128446077 iteration 36: w = [0.99967788 1.98899822 2.94660163 3.98999138 4.96612991], F(w) = 0.7838747947550708 iteration 37: w = [0.99970141 1.98901237 2.9465935 3.98998703 4.96612858], F(w) = 0.7839159121529184 iteration 38: w = [0.99972375 1.98902583 2.94658585 3.98998298 4.96612731], F(w) = 0.7839546809704756 iteration 39: w = [0.99974496 1.98903865 2.94657864 3.98997921 4.96612611], F(w) = 0.783991293813168 iteration 40: w = [0.99976514 1.98905087 2.94657183 3.98997567 4.96612496], F(w) = 0.7840259230025781 iteration 41: w = [0.99978436 1.98906253 2.9465654 3.98997236 4.96612387], F(w) = 0.7840587231580829 iteration 42: w = [0.99980268 1.98907367 2.9465593 3.98996926 4.96612284], F(w) = 0.7840898333963451 iteration 43: w = [0.99982017 1.98908432 2.94655352 3.98996634 4.96612184], F(w) = 0.7841193792124117 iteration 44: w = [0.99983688 1.98909452 2.94654804 3.9899636 4.9661209 ], F(w) = 0.7841474740952239 iteration 45: w = [0.99985287 1.98910429 2.94654282 3.98996101 4.96611999], F(w) = 0.7841742209196012 iteration 46: w = [0.99986818 1.98911366 2.94653786 3.98995858 4.96611912], F(w) = 0.784199713150188 iteration 47: w = [0.99988284 1.98912266 2.94653313 3.98995627 4.96611828], F(w) = 0.7842240358857864 iteration 48: w = [0.99989691 1.9891313 2.94652862 3.98995409 4.96611748], F(w) = 0.7842472667686391 iteration 49: w = [0.99991042 1.98913961 2.94652431 3.98995203 4.96611672], F(w) = 0.7842694767781414 iteration 50: w = [0.9999234 1.9891476 2.94652019 3.98995007 4.96611598], F(w) = 0.7842907309257899 iteration 51: w = [0.99993588 1.9891553 2.94651625 3.98994821 4.96611527], F(w) = 0.7843110888653835 iteration 52: w = [0.99994788 1.98916272 2.94651248 3.98994645 4.96611458], F(w) = 0.7843306054303205 iteration 53: w = [0.99995945 1.98916987 2.94650887 3.98994477 4.96611392], F(w) = 0.7843493311076808 iteration 54: w = [0.99997059 1.98917677 2.9465054 3.98994317 4.96611328], F(w) = 0.7843673124578789 iteration 55: w = [0.99998133 1.98918343 2.94650207 3.98994165 4.96611267], F(w) = 0.7843845924866253 iteration 56: w = [0.9999917 1.98918986 2.94649888 3.98994019 4.96611208], F(w) = 0.7844012109759604 iteration 57: w = [1.00000171 1.98919608 2.9464958 3.98993881 4.9661115 ], F(w) = 0.7844172047787056 iteration 58: w = [1.00001138 1.9892021 2.94649284 3.98993748 4.96611095], F(w) = 0.7844326080817181 iteration 59: w = [1.00002073 1.98920792 2.94649 3.98993621 4.96611041], F(w) = 0.7844474526412584 iteration 60: w = [1.00002977 1.98921356 2.94648725 3.989935 4.96610989], F(w) = 0.7844617679939123 iteration 61: w = [1.00003852 1.98921901 2.94648461 3.98993384 4.96610939], F(w) = 0.7844755816461602 iteration 62: w = [1.00004699 1.98922431 2.94648206 3.98993273 4.9661089 ], F(w) = 0.7844889192448 iteration 63: w = [1.0000552 1.98922944 2.94647959 3.98993166 4.96610843], F(w) = 0.7845018047306714 iteration 64: w = [1.00006316 1.98923441 2.94647722 3.98993064 4.96610797], F(w) = 0.7845142604773079 iteration 65: w = [1.00007087 1.98923924 2.94647492 3.98992965 4.96610752], F(w) = 0.7845263074165054 iteration 66: w = [1.00007836 1.98924393 2.94647269 3.98992871 4.96610709], F(w) = 0.7845379651520031 iteration 67: w = [1.00008562 1.98924849 2.94647054 3.9899278 4.96610667], F(w) = 0.7845492520625397 iteration 68: w = [1.00009268 1.98925292 2.94646846 3.98992693 4.96610626], F(w) = 0.7845601853955414 iteration 69: w = [1.00009953 1.98925722 2.94646645 3.98992609 4.96610586], F(w) = 0.784570781352515 iteration 70: w = [1.00010619 1.98926141 2.94646449 3.98992528 4.96610547], F(w) = 0.784581055166612 iteration 71: w = [1.00011266 1.98926548 2.9464626 3.98992449 4.9661051 ], F(w) = 0.7845910211736271 iteration 72: w = [1.00011896 1.98926944 2.94646076 3.98992374 4.96610473], F(w) = 0.7846006928767313 iteration 73: w = [1.00012509 1.9892733 2.94645898 3.98992301 4.96610437], F(w) = 0.7846100830057363 iteration 74: w = [1.00013105 1.98927706 2.94645725 3.98992231 4.96610403], F(w) = 0.7846192035715179 iteration 75: w = [1.00013686 1.98928073 2.94645557 3.98992164 4.96610369], F(w) = 0.7846280659156685 iteration 76: w = [1.00014251 1.9892843 2.94645394 3.98992098 4.96610336], F(w) = 0.784636680756338 iteration 77: w = [1.00014803 1.98928778 2.94645235 3.98992035 4.96610303], F(w) = 0.7846450582302469 iteration 78: w = [1.0001534 1.98929117 2.94645081 3.98991974 4.96610272], F(w) = 0.7846532079314801 iteration 79: w = [1.00015864 1.98929448 2.94644931 3.98991914 4.96610241], F(w) = 0.7846611389470514 iteration 80: w = [1.00016374 1.98929771 2.94644786 3.98991857 4.96610211], F(w) = 0.7846688598898351 iteration 81: w = [1.00016873 1.98930087 2.94644644 3.98991802 4.96610182], F(w) = 0.7846763789289819 iteration 82: w = [1.00017359 1.98930395 2.94644505 3.98991748 4.96610153], F(w) = 0.7846837038179375 iteration 83: w = [1.00017834 1.98930696 2.94644371 3.98991696 4.96610126], F(w) = 0.7846908419205175 iteration 84: w = [1.00018298 1.9893099 2.9464424 3.98991645 4.96610098], F(w) = 0.7846978002349126 iteration 85: w = [1.00018751 1.98931277 2.94644112 3.98991596 4.96610072], F(w) = 0.7847045854160164 iteration 86: w = [1.00019193 1.98931558 2.94643987 3.98991549 4.96610045], F(w) = 0.7847112037961657 iteration 87: w = [1.00019625 1.98931832 2.94643865 3.98991503 4.9661002 ], F(w) = 0.7847176614042584 iteration 88: w = [1.00020048 1.98932101 2.94643747 3.98991458 4.96609995], F(w) = 0.784723963983769 iteration 89: w = [1.00020462 1.98932364 2.94643631 3.98991414 4.9660997 ], F(w) = 0.7847301170092711 iteration 90: w = [1.00020866 1.98932621 2.94643518 3.98991372 4.96609946], F(w) = 0.7847361257019777 iteration 91: w = [1.00021261 1.98932872 2.94643408 3.98991331 4.96609923], F(w) = 0.7847419950441793 iteration 92: w = [1.00021648 1.98933118 2.946433 3.98991291 4.966099 ], F(w) = 0.784747729792665 iteration 93: w = [1.00022027 1.9893336 2.94643195 3.98991252 4.96609878], F(w) = 0.7847533344912703 iteration 94: w = [1.00022398 1.98933596 2.94643092 3.98991214 4.96609856], F(w) = 0.7847588134826459 iteration 95: w = [1.00022761 1.98933827 2.94642992 3.98991178 4.96609834], F(w) = 0.7847641709192538 iteration 96: w = [1.00023116 1.98934054 2.94642893 3.98991142 4.96609813], F(w) = 0.78476941077357 iteration 97: w = [1.00023465 1.98934276 2.94642797 3.98991107 4.96609792], F(w) = 0.7847745368476855 iteration 98: w = [1.00023806 1.98934493 2.94642703 3.98991073 4.96609772], F(w) = 0.7847795527823793 iteration 99: w = [1.0002414 1.98934707 2.94642611 3.9899104 4.96609752], F(w) = 0.7847844620654985 iteration 100: w = [1.00024468 1.98934916 2.94642521 3.98991007 4.96609732], F(w) = 0.7847892680398596 iteration 101: w = [1.0002479 1.98935122 2.94642433 3.98990976 4.96609713], F(w) = 0.7847939739107556 iteration 102: w = [1.00025105 1.98935323 2.94642347 3.98990945 4.96609694], F(w) = 0.7847985827528058 iteration 103: w = [1.00025414 1.9893552 2.94642263 3.98990915 4.96609676], F(w) = 0.7848030975166845 iteration 104: w = [1.00025717 1.98935714 2.9464218 3.98990886 4.96609657], F(w) = 0.7848075210351195 iteration 105: w = [1.00026015 1.98935905 2.94642099 3.98990858 4.9660964 ], F(w) = 0.7848118560288021 iteration 106: w = [1.00026307 1.98936091 2.9464202 3.9899083 4.96609622], F(w) = 0.7848161051118432 iteration 107: w = [1.00026593 1.98936275 2.94641942 3.98990803 4.96609605], F(w) = 0.7848202707968787 iteration 108: w = [1.00026875 1.98936455 2.94641866 3.98990776 4.96609588], F(w) = 0.7848243554999953 iteration 109: w = [1.00027151 1.98936632 2.94641791 3.9899075 4.96609571], F(w) = 0.7848283615452541 iteration 110: w = [1.00027422 1.98936805 2.94641718 3.98990725 4.96609555], F(w) = 0.7848322911689938 iteration 111: w = [1.00027688 1.98936976 2.94641646 3.989907 4.96609539], F(w) = 0.784836146524014 iteration 112: w = [1.0002795 1.98937144 2.94641575 3.98990676 4.96609523], F(w) = 0.7848399296833257 iteration 113: w = [1.00028207 1.98937309 2.94641506 3.98990653 4.96609508], F(w) = 0.784843642643839 iteration 114: w = [1.0002846 1.98937471 2.94641438 3.9899063 4.96609493], F(w) = 0.7848472873298454 iteration 115: w = [1.00028708 1.9893763 2.94641371 3.98990607 4.96609478], F(w) = 0.7848508655962539 iteration 116: w = [1.00028952 1.98937786 2.94641306 3.98990585 4.96609463], F(w) = 0.7848543792315882 iteration 117: w = [1.00029192 1.9893794 2.94641242 3.98990563 4.96609448], F(w) = 0.7848578299610571 iteration 118: w = [1.00029428 1.98938092 2.94641179 3.98990542 4.96609434], F(w) = 0.7848612194492669 iteration 119: w = [1.0002966 1.98938241 2.94641117 3.98990521 4.9660942 ], F(w) = 0.7848645493029182 iteration 120: w = [1.00029888 1.98938387 2.94641056 3.98990501 4.96609406], F(w) = 0.7848678210731371 iteration 121: w = [1.00030112 1.98938532 2.94640996 3.98990481 4.96609392], F(w) = 0.7848710362579374 iteration 122: w = [1.00030333 1.98938673 2.94640937 3.98990462 4.96609379], F(w) = 0.7848741963045434 iteration 123: w = [1.0003055 1.98938813 2.9464088 3.98990443 4.96609366], F(w) = 0.7848773026113857 iteration 124: w = [1.00030764 1.9893895 2.94640823 3.98990424 4.96609353], F(w) = 0.7848803565302099 iteration 125: w = [1.00030974 1.98939086 2.94640767 3.98990406 4.9660934 ], F(w) = 0.7848833593680171 iteration 126: w = [1.00031181 1.98939219 2.94640712 3.98990388 4.96609328], F(w) = 0.7848863123888379 iteration 127: w = [1.00031385 1.9893935 2.94640658 3.9899037 4.96609315], F(w) = 0.7848892168154445 iteration 128: w = [1.00031585 1.98939479 2.94640605 3.98990353 4.96609303], F(w) = 0.7848920738311517 iteration 129: w = [1.00031783 1.98939606 2.94640553 3.98990336 4.96609291], F(w) = 0.7848948845812886 iteration 130: w = [1.00031977 1.98939731 2.94640502 3.9899032 4.96609279], F(w) = 0.7848976501747522 iteration 131: w = [1.00032169 1.98939855 2.94640451 3.98990303 4.96609267], F(w) = 0.7849003716853561 iteration 132: w = [1.00032358 1.98939976 2.94640402 3.98990287 4.96609256], F(w) = 0.7849030501533288 iteration 133: w = [1.00032544 1.98940096 2.94640353 3.98990272 4.96609244], F(w) = 0.7849056865865294 iteration 134: w = [1.00032727 1.98940214 2.94640305 3.98990257 4.96609233], F(w) = 0.7849082819616994 iteration 135: w = [1.00032907 1.9894033 2.94640257 3.98990241 4.96609222], F(w) = 0.7849108372256932 iteration 136: w = [1.00033085 1.98940445 2.94640211 3.98990227 4.96609211], F(w) = 0.7849133532965971 iteration 137: w = [1.0003326 1.98940558 2.94640165 3.98990212 4.96609201], F(w) = 0.7849158310646829 iteration 138: w = [1.00033433 1.98940669 2.9464012 3.98990198 4.9660919 ], F(w) = 0.7849182713936721 iteration 139: w = [1.00033603 1.98940779 2.94640075 3.98990184 4.9660918 ], F(w) = 0.7849206751215679 iteration 140: w = [1.00033771 1.98940888 2.94640031 3.9899017 4.96609169], F(w) = 0.7849230430616649 iteration 141: w = [1.00033936 1.98940994 2.94639988 3.98990157 4.96609159], F(w) = 0.7849253760033673 iteration 142: w = [1.000341 1.989411 2.94639946 3.98990143 4.96609149], F(w) = 0.7849276747131766 iteration 143: w = [1.0003426 1.98941203 2.94639904 3.9899013 4.96609139], F(w) = 0.7849299399354298 iteration 144: w = [1.00034419 1.98941306 2.94639862 3.98990118 4.96609129], F(w) = 0.7849321723931031 iteration 145: w = [1.00034576 1.98941407 2.94639822 3.98990105 4.9660912 ], F(w) = 0.7849343727886122 iteration 146: w = [1.0003473 1.98941507 2.94639782 3.98990093 4.9660911 ], F(w) = 0.784936541804433 iteration 147: w = [1.00034882 1.98941605 2.94639742 3.9899008 4.96609101], F(w) = 0.784938680103969 iteration 148: w = [1.00035032 1.98941702 2.94639703 3.98990069 4.96609092], F(w) = 0.784940788332037 iteration 149: w = [1.00035181 1.98941798 2.94639665 3.98990057 4.96609083], F(w) = 0.7849428671156744 iteration 150: w = [1.00035327 1.98941893 2.94639627 3.98990045 4.96609074], F(w) = 0.7849449170646294 iteration 151: w = [1.00035471 1.98941986 2.94639589 3.98990034 4.96609065], F(w) = 0.784946938771943 iteration 152: w = [1.00035614 1.98942078 2.94639553 3.98990023 4.96609056], F(w) = 0.7849489328146139 iteration 153: w = [1.00035754 1.98942169 2.94639516 3.98990012 4.96609047], F(w) = 0.784950899754079 iteration 154: w = [1.00035893 1.98942259 2.9463948 3.98990001 4.96609039], F(w) = 0.7849528401366941 iteration 155: w = [1.0003603 1.98942347 2.94639445 3.9898999 4.9660903 ], F(w) = 0.784954754494287 iteration 156: w = [1.00036166 1.98942435 2.9463941 3.9898998 4.96609022], F(w) = 0.7849566433446741 iteration 157: w = [1.00036299 1.98942521 2.94639376 3.98989969 4.96609013], F(w) = 0.7849585071919933 iteration 158: w = [1.00036431 1.98942607 2.94639342 3.98989959 4.96609005], F(w) = 0.7849603465273215 iteration 159: w = [1.00036561 1.98942691 2.94639308 3.98989949 4.96608997], F(w) = 0.7849621618289534 iteration 160: w = [1.0003669 1.98942774 2.94639275 3.98989939 4.96608989], F(w) = 0.7849639535627918 iteration 161: w = [1.00036817 1.98942857 2.94639243 3.9898993 4.96608981], F(w) = 0.7849657221828886 iteration 162: w = [1.00036942 1.98942938 2.94639211 3.9898992 4.96608974], F(w) = 0.7849674681317499 iteration 163: w = [1.00037066 1.98943018 2.94639179 3.98989911 4.96608966], F(w) = 0.7849691918406527 iteration 164: w = [1.00037189 1.98943097 2.94639147 3.98989902 4.96608958], F(w) = 0.7849708937300942 iteration 165: w = [1.0003731 1.98943176 2.94639116 3.98989892 4.96608951], F(w) = 0.7849725742099687 iteration 166: w = [1.00037429 1.98943253 2.94639086 3.98989883 4.96608943], F(w) = 0.7849742336801206 iteration 167: w = [1.00037547 1.9894333 2.94639056 3.98989875 4.96608936], F(w) = 0.7849758725304602 iteration 168: w = [1.00037664 1.98943405 2.94639026 3.98989866 4.96608929], F(w) = 0.7849774911413436 iteration 169: w = [1.00037779 1.9894348 2.94638996 3.98989857 4.96608922], F(w) = 0.7849790898838594 iteration 170: w = [1.00037893 1.98943554 2.94638967 3.98989849 4.96608914], F(w) = 0.7849806691201262 iteration 171: w = [1.00038006 1.98943627 2.94638939 3.98989841 4.96608907], F(w) = 0.7849822292035266 iteration 172: w = [1.00038117 1.98943699 2.9463891 3.98989832 4.966089 ], F(w) = 0.7849837704789704 iteration 173: w = [1.00038228 1.98943771 2.94638882 3.98989824 4.96608894], F(w) = 0.7849852932832011 iteration 174: w = [1.00038336 1.98943841 2.94638855 3.98989816 4.96608887], F(w) = 0.7849867979448999 iteration 175: w = [1.00038444 1.98943911 2.94638827 3.98989808 4.9660888 ], F(w) = 0.7849882847851763 iteration 176: w = [1.0003855 1.9894398 2.946388 3.98989801 4.96608873], F(w) = 0.78498975411746 iteration 177: w = [1.00038656 1.98944048 2.94638773 3.98989793 4.96608867], F(w) = 0.7849912062480275 iteration 178: w = [1.0003876 1.98944116 2.94638747 3.98989785 4.9660886 ], F(w) = 0.7849926414760073 iteration 179: w = [1.00038862 1.98944183 2.94638721 3.98989778 4.96608854], F(w) = 0.7849940600936216 iteration 180: w = [1.00038964 1.98944249 2.94638695 3.98989771 4.96608848], F(w) = 0.78499546238653 iteration 181: w = [1.00039065 1.98944314 2.9463867 3.98989763 4.96608841], F(w) = 0.7849968486337782 iteration 182: w = [1.00039164 1.98944379 2.94638644 3.98989756 4.96608835], F(w) = 0.7849982191081799 iteration 183: w = [1.00039263 1.98944443 2.9463862 3.98989749 4.96608829], F(w) = 0.7849995740763192 iteration 184: w = [1.0003936 1.98944506 2.94638595 3.98989742 4.96608823], F(w) = 0.7850009137989612 iteration 185: w = [1.00039456 1.98944568 2.94638571 3.98989735 4.96608817], F(w) = 0.7850022385309989 iteration 186: w = [1.00039552 1.9894463 2.94638546 3.98989729 4.96608811], F(w) = 0.7850035485216671 iteration 187: w = [1.00039646 1.98944692 2.94638523 3.98989722 4.96608805], F(w) = 0.785004844014745 iteration 188: w = [1.00039739 1.98944752 2.94638499 3.98989715 4.96608799], F(w) = 0.7850061252486937 iteration 189: w = [1.00039831 1.98944812 2.94638476 3.98989709 4.96608793], F(w) = 0.7850073924568018 iteration 190: w = [1.00039923 1.98944871 2.94638453 3.98989702 4.96608788], F(w) = 0.7850086458672726 iteration 191: w = [1.00040013 1.9894493 2.9463843 3.98989696 4.96608782], F(w) = 0.7850098857034046 iteration 192: w = [1.00040103 1.98944988 2.94638408 3.9898969 4.96608776], F(w) = 0.785011112183735 iteration 193: w = [1.00040191 1.98945046 2.94638385 3.98989684 4.96608771], F(w) = 0.7850123255221304 iteration 194: w = [1.00040279 1.98945103 2.94638363 3.98989677 4.96608765], F(w) = 0.7850135259279419 iteration 195: w = [1.00040365 1.98945159 2.94638341 3.98989671 4.9660876 ], F(w) = 0.7850147136060941 iteration 196: w = [1.00040451 1.98945215 2.9463832 3.98989665 4.96608754], F(w) = 0.7850158887572108 iteration 197: w = [1.00040536 1.9894527 2.94638299 3.9898966 4.96608749], F(w) = 0.7850170515777637 iteration 198: w = [1.0004062 1.98945325 2.94638277 3.98989654 4.96608744], F(w) = 0.7850182022601645 iteration 199: w = [1.00040704 1.98945379 2.94638256 3.98989648 4.96608738], F(w) = 0.7850193409927638 iteration 200: w = [1.00040786 1.98945433 2.94638236 3.98989642 4.96608733], F(w) = 0.7850204679600977 iteration 201: w = [1.00040868 1.98945486 2.94638215 3.98989637 4.96608728], F(w) = 0.7850215833429622 iteration 202: w = [1.00040949 1.98945539 2.94638195 3.98989631 4.96608723], F(w) = 0.7850226873184569 iteration 203: w = [1.00041029 1.98945591 2.94638175 3.98989626 4.96608718], F(w) = 0.7850237800600796 iteration 204: w = [1.00041108 1.98945642 2.94638155 3.9898962 4.96608713], F(w) = 0.7850248617378143 iteration 205: w = [1.00041186 1.98945693 2.94638136 3.98989615 4.96608708], F(w) = 0.7850259325183263 iteration 206: w = [1.00041264 1.98945744 2.94638116 3.9898961 4.96608703], F(w) = 0.7850269925648745 iteration 207: w = [1.00041341 1.98945794 2.94638097 3.98989605 4.96608698], F(w) = 0.785028042037531 iteration 208: w = [1.00041417 1.98945844 2.94638078 3.98989599 4.96608693], F(w) = 0.78502908109315 iteration 209: w = [1.00041493 1.98945893 2.94638059 3.98989594 4.96608689], F(w) = 0.7850301098855849 iteration 210: w = [1.00041568 1.98945942 2.9463804 3.98989589 4.96608684], F(w) = 0.7850311285656207 iteration 211: w = [1.00041642 1.9894599 2.94638022 3.98989584 4.96608679], F(w) = 0.7850321372811456 iteration 212: w = [1.00041715 1.98946038 2.94638004 3.98989579 4.96608675], F(w) = 0.7850331361771742 iteration 213: w = [1.00041788 1.98946085 2.94637985 3.98989575 4.9660867 ], F(w) = 0.7850341253959265 iteration 214: w = [1.0004186 1.98946132 2.94637967 3.9898957 4.96608665], F(w) = 0.7850351050768893 iteration 215: w = [1.00041931 1.98946178 2.9463795 3.98989565 4.96608661], F(w) = 0.7850360753569089 iteration 216: w = [1.00042002 1.98946224 2.94637932 3.9898956 4.96608656], F(w) = 0.7850370363701955 iteration 217: w = [1.00042072 1.9894627 2.94637915 3.98989556 4.96608652], F(w) = 0.7850379882484784 iteration 218: w = [1.00042142 1.98946315 2.94637897 3.98989551 4.96608648], F(w) = 0.7850389311209134 iteration 219: w = [1.0004221 1.9894636 2.9463788 3.98989547 4.96608643], F(w) = 0.7850398651143579 iteration 220: w = [1.00042279 1.98946405 2.94637863 3.98989542 4.96608639], F(w) = 0.7850407903532501 iteration 221: w = [1.00042346 1.98946449 2.94637847 3.98989538 4.96608635], F(w) = 0.7850417069596651 iteration 222: w = [1.00042413 1.98946492 2.9463783 3.98989533 4.9660863 ], F(w) = 0.7850426150535017 iteration 223: w = [1.0004248 1.98946536 2.94637813 3.98989529 4.96608626], F(w) = 0.7850435147524081 iteration 224: w = [1.00042545 1.98946578 2.94637797 3.98989525 4.96608622], F(w) = 0.785044406171921 iteration 225: w = [1.0004261 1.98946621 2.94637781 3.9898952 4.96608618], F(w) = 0.7850452894254714 iteration 226: w = [1.00042675 1.98946663 2.94637765 3.98989516 4.96608614], F(w) = 0.7850461646243395 iteration 227: w = [1.00042739 1.98946705 2.94637749 3.98989512 4.9660861 ], F(w) = 0.7850470318778934 iteration 228: w = [1.00042803 1.98946746 2.94637733 3.98989508 4.96608606], F(w) = 0.7850478912934947 iteration 229: w = [1.00042866 1.98946787 2.94637718 3.98989504 4.96608602], F(w) = 0.7850487429765964 iteration 230: w = [1.00042928 1.98946828 2.94637702 3.989895 4.96608598], F(w) = 0.7850495870308118 iteration 231: w = [1.0004299 1.98946868 2.94637687 3.98989496 4.96608594], F(w) = 0.7850504235578771 iteration 232: w = [1.00043051 1.98946908 2.94637672 3.98989492 4.9660859 ], F(w) = 0.7850512526576918 iteration 233: w = [1.00043112 1.98946948 2.94637657 3.98989488 4.96608586], F(w) = 0.7850520744284167 iteration 234: w = [1.00043172 1.98946987 2.94637642 3.98989484 4.96608582], F(w) = 0.785052888966565 iteration 235: w = [1.00043232 1.98947026 2.94637627 3.9898948 4.96608578], F(w) = 0.7850536963669047 iteration 236: w = [1.00043291 1.98947065 2.94637613 3.98989477 4.96608574], F(w) = 0.7850544967225673 iteration 237: w = [1.0004335 1.98947103 2.94637598 3.98989473 4.96608571], F(w) = 0.7850552901250539 iteration 238: w = [1.00043408 1.98947141 2.94637584 3.98989469 4.96608567], F(w) = 0.7850560766643504 iteration 239: w = [1.00043466 1.98947179 2.94637569 3.98989466 4.96608563], F(w) = 0.7850568564288388 iteration 240: w = [1.00043524 1.98947217 2.94637555 3.98989462 4.9660856 ], F(w) = 0.7850576295054522 iteration 241: w = [1.0004358 1.98947254 2.94637541 3.98989458 4.96608556], F(w) = 0.7850583959796097 iteration 242: w = [1.00043637 1.9894729 2.94637527 3.98989455 4.96608552], F(w) = 0.7850591559352557 iteration 243: w = [1.00043693 1.98947327 2.94637514 3.98989451 4.96608549], F(w) = 0.785059909454972 iteration 244: w = [1.00043748 1.98947363 2.946375 3.98989448 4.96608545], F(w) = 0.7850606566199367 iteration 245: w = [1.00043803 1.98947399 2.94637486 3.98989444 4.96608542], F(w) = 0.7850613975099512 iteration 246: w = [1.00043858 1.98947435 2.94637473 3.98989441 4.96608538], F(w) = 0.7850621322035353 iteration 247: w = [1.00043912 1.9894747 2.9463746 3.98989437 4.96608535], F(w) = 0.7850628607778483 iteration 248: w = [1.00043966 1.98947505 2.94637446 3.98989434 4.96608531], F(w) = 0.7850635833088373 iteration 249: w = [1.00044019 1.9894754 2.94637433 3.98989431 4.96608528], F(w) = 0.785064299871175 iteration 250: w = [1.00044072 1.98947574 2.9463742 3.98989428 4.96608525], F(w) = 0.7850650105382907 iteration 251: w = [1.00044124 1.98947609 2.94637407 3.98989424 4.96608521], F(w) = 0.7850657153824306 iteration 252: w = [1.00044176 1.98947643 2.94637395 3.98989421 4.96608518], F(w) = 0.785066414474648 iteration 253: w = [1.00044228 1.98947676 2.94637382 3.98989418 4.96608515], F(w) = 0.7850671078849146 iteration 254: w = [1.00044279 1.9894771 2.94637369 3.98989415 4.96608511], F(w) = 0.7850677956820226 iteration 255: w = [1.0004433 1.98947743 2.94637357 3.98989412 4.96608508], F(w) = 0.785068477933659 iteration 256: w = [1.0004438 1.98947776 2.94637345 3.98989408 4.96608505], F(w) = 0.7850691547064566 iteration 257: w = [1.0004443 1.98947809 2.94637332 3.98989405 4.96608502], F(w) = 0.7850698260659166 iteration 258: w = [1.0004448 1.98947841 2.9463732 3.98989402 4.96608499], F(w) = 0.7850704920765758 iteration 259: w = [1.00044529 1.98947873 2.94637308 3.98989399 4.96608495], F(w) = 0.7850711528019604 iteration 260: w = [1.00044578 1.98947905 2.94637296 3.98989396 4.96608492], F(w) = 0.7850718083045456 iteration 261: w = [1.00044626 1.98947937 2.94637284 3.98989393 4.96608489], F(w) = 0.7850724586458089 iteration 262: w = [1.00044674 1.98947968 2.94637273 3.9898939 4.96608486], F(w) = 0.7850731038863525 iteration 263: w = [1.00044722 1.98947999 2.94637261 3.98989388 4.96608483], F(w) = 0.7850737440857674 iteration 264: w = [1.0004477 1.9894803 2.94637249 3.98989385 4.9660848 ], F(w) = 0.7850743793027657 iteration 265: w = [1.00044817 1.98948061 2.94637238 3.98989382 4.96608477], F(w) = 0.7850750095951173 iteration 266: w = [1.00044863 1.98948092 2.94637226 3.98989379 4.96608474], F(w) = 0.7850756350197281 iteration 267: w = [1.0004491 1.98948122 2.94637215 3.98989376 4.96608471], F(w) = 0.7850762556326086 iteration 268: w = [1.00044956 1.98948152 2.94637204 3.98989373 4.96608468], F(w) = 0.7850768714889242 iteration 269: w = [1.00045001 1.98948182 2.94637193 3.98989371 4.96608465], F(w) = 0.7850774826430266 iteration 270: w = [1.00045047 1.98948212 2.94637182 3.98989368 4.96608462], F(w) = 0.7850780891484053 iteration 271: w = [1.00045092 1.98948241 2.94637171 3.98989365 4.96608459], F(w) = 0.7850786910577877 iteration 272: w = [1.00045136 1.9894827 2.9463716 3.98989363 4.96608456], F(w) = 0.7850792884230349 iteration 273: w = [1.00045181 1.98948299 2.94637149 3.9898936 4.96608454], F(w) = 0.7850798812953493 iteration 274: w = [1.00045225 1.98948328 2.94637138 3.98989357 4.96608451], F(w) = 0.7850804697250355 iteration 275: w = [1.00045268 1.98948357 2.94637127 3.98989355 4.96608448], F(w) = 0.7850810537617302 iteration 276: w = [1.00045312 1.98948385 2.94637117 3.98989352 4.96608445], F(w) = 0.7850816334543608 iteration 277: w = [1.00045355 1.98948413 2.94637106 3.98989349 4.96608442], F(w) = 0.7850822088510614 iteration 278: w = [1.00045397 1.98948441 2.94637096 3.98989347 4.9660844 ], F(w) = 0.7850827799992437 iteration 279: w = [1.0004544 1.98948469 2.94637086 3.98989344 4.96608437], F(w) = 0.7850833469457545 iteration 280: w = [1.00045482 1.98948496 2.94637075 3.98989342 4.96608434], F(w) = 0.7850839097365957 iteration 281: w = [1.00045524 1.98948524 2.94637065 3.98989339 4.96608431], F(w) = 0.7850844684172228 iteration 282: w = [1.00045565 1.98948551 2.94637055 3.98989337 4.96608429], F(w) = 0.7850850230323565 iteration 283: w = [1.00045607 1.98948578 2.94637045 3.98989335 4.96608426], F(w) = 0.7850855736261292 iteration 284: w = [1.00045648 1.98948605 2.94637035 3.98989332 4.96608423], F(w) = 0.7850861202419914 iteration 285: w = [1.00045688 1.98948631 2.94637025 3.9898933 4.96608421], F(w) = 0.7850866629227913 iteration 286: w = [1.00045729 1.98948658 2.94637015 3.98989327 4.96608418], F(w) = 0.7850872017107803 iteration 287: w = [1.00045769 1.98948684 2.94637006 3.98989325 4.96608416], F(w) = 0.7850877366475806 iteration 288: w = [1.00045809 1.9894871 2.94636996 3.98989323 4.96608413], F(w) = 0.7850882677742383 iteration 289: w = [1.00045848 1.98948736 2.94636986 3.9898932 4.96608411], F(w) = 0.7850887951312063 iteration 290: w = [1.00045888 1.98948762 2.94636977 3.98989318 4.96608408], F(w) = 0.7850893187583708 iteration 291: w = [1.00045927 1.98948787 2.94636967 3.98989316 4.96608405], F(w) = 0.7850898386950972 iteration 292: w = [1.00045965 1.98948813 2.94636958 3.98989313 4.96608403], F(w) = 0.785090354980156 iteration 293: w = [1.00046004 1.98948838 2.94636949 3.98989311 4.966084 ], F(w) = 0.7850908676517843 iteration 294: w = [1.00046042 1.98948863 2.94636939 3.98989309 4.96608398], F(w) = 0.7850913767476965 iteration 295: w = [1.0004608 1.98948888 2.9463693 3.98989307 4.96608396], F(w) = 0.7850918823050815 iteration 296: w = [1.00046118 1.98948912 2.94636921 3.98989305 4.96608393], F(w) = 0.7850923843606263 iteration 297: w = [1.00046155 1.98948937 2.94636912 3.98989302 4.96608391], F(w) = 0.785092882950519 iteration 298: w = [1.00046192 1.98948961 2.94636903 3.989893 4.96608388], F(w) = 0.7850933781103591 iteration 299: w = [1.00046229 1.98948986 2.94636894 3.98989298 4.96608386], F(w) = 0.7850938698754011 iteration 300: w = [1.00046266 1.9894901 2.94636885 3.98989296 4.96608384], F(w) = 0.7850943582803271 iteration 301: w = [1.00046303 1.98949034 2.94636876 3.98989294 4.96608381], F(w) = 0.7850948433593913 iteration 302: w = [1.00046339 1.98949057 2.94636867 3.98989292 4.96608379], F(w) = 0.7850953251463704 iteration 303: w = [1.00046375 1.98949081 2.94636859 3.9898929 4.96608376], F(w) = 0.7850958036745851 iteration 304: w = [1.00046411 1.98949104 2.9463685 3.98989288 4.96608374], F(w) = 0.7850962789769471 iteration 305: w = [1.00046446 1.98949128 2.94636841 3.98989286 4.96608372], F(w) = 0.7850967510858218 iteration 306: w = [1.00046482 1.98949151 2.94636833 3.98989284 4.9660837 ], F(w) = 0.7850972200332205 iteration 307: w = [1.00046517 1.98949174 2.94636824 3.98989282 4.96608367], F(w) = 0.78509768585075 iteration 308: w = [1.00046551 1.98949196 2.94636816 3.9898928 4.96608365], F(w) = 0.7850981485696034 iteration 309: w = [1.00046586 1.98949219 2.94636808 3.98989278 4.96608363], F(w) = 0.7850986082204512 iteration 310: w = [1.0004662 1.98949242 2.94636799 3.98989276 4.96608361], F(w) = 0.7850990648336742 iteration 311: w = [1.00046655 1.98949264 2.94636791 3.98989274 4.96608358], F(w) = 0.7850995184392066 iteration 312: w = [1.00046689 1.98949286 2.94636783 3.98989272 4.96608356], F(w) = 0.7850999690666155 iteration 313: w = [1.00046722 1.98949308 2.94636775 3.9898927 4.96608354], F(w) = 0.7851004167450529 iteration 314: w = [1.00046756 1.9894933 2.94636767 3.98989268 4.96608352], F(w) = 0.7851008615032992 iteration 315: w = [1.00046789 1.98949352 2.94636758 3.98989266 4.9660835 ], F(w) = 0.7851013033697618 iteration 316: w = [1.00046822 1.98949374 2.94636751 3.98989264 4.96608347], F(w) = 0.7851017423725162 iteration 317: w = [1.00046855 1.98949396 2.94636743 3.98989262 4.96608345], F(w) = 0.7851021785392285 iteration 318: w = [1.00046888 1.98949417 2.94636735 3.98989261 4.96608343], F(w) = 0.7851026118972707 iteration 319: w = [1.0004692 1.98949438 2.94636727 3.98989259 4.96608341], F(w) = 0.7851030424735693 iteration 320: w = [1.00046953 1.98949459 2.94636719 3.98989257 4.96608339], F(w) = 0.7851034702948211 iteration 321: w = [1.00046985 1.9894948 2.94636711 3.98989255 4.96608337], F(w) = 0.7851038953872823 iteration 322: w = [1.00047017 1.98949501 2.94636704 3.98989253 4.96608335], F(w) = 0.7851043177769272 iteration 323: w = [1.00047048 1.98949522 2.94636696 3.98989252 4.96608333], F(w) = 0.7851047374894204 iteration 324: w = [1.0004708 1.98949543 2.94636688 3.9898925 4.96608331], F(w) = 0.7851051545500343 iteration 325: w = [1.00047111 1.98949563 2.94636681 3.98989248 4.96608329], F(w) = 0.7851055689838194 iteration 326: w = [1.00047142 1.98949584 2.94636673 3.98989246 4.96608327], F(w) = 0.7851059808154159 iteration 327: w = [1.00047173 1.98949604 2.94636666 3.98989245 4.96608325], F(w) = 0.7851063900692022 iteration 328: w = [1.00047204 1.98949624 2.94636659 3.98989243 4.96608323], F(w) = 0.7851067967693225 iteration 329: w = [1.00047234 1.98949644 2.94636651 3.98989241 4.96608321], F(w) = 0.7851072009394614 iteration 330: w = [1.00047265 1.98949664 2.94636644 3.98989239 4.96608319], F(w) = 0.7851076026031698 iteration 331: w = [1.00047295 1.98949684 2.94636637 3.98989238 4.96608317], F(w) = 0.7851080017835878 iteration 332: w = [1.00047325 1.98949703 2.94636629 3.98989236 4.96608315], F(w) = 0.7851083985036333 iteration 333: w = [1.00047355 1.98949723 2.94636622 3.98989234 4.96608313], F(w) = 0.7851087927859385 iteration 334: w = [1.00047385 1.98949742 2.94636615 3.98989233 4.96608311], F(w) = 0.7851091846529004 iteration 335: w = [1.00047414 1.98949762 2.94636608 3.98989231 4.96608309], F(w) = 0.7851095741265637 iteration 336: w = [1.00047443 1.98949781 2.94636601 3.9898923 4.96608307], F(w) = 0.7851099612287261 iteration 337: w = [1.00047472 1.989498 2.94636594 3.98989228 4.96608305], F(w) = 0.7851103459809524 iteration 338: w = [1.00047501 1.98949819 2.94636587 3.98989226 4.96608303], F(w) = 0.7851107284045398 iteration 339: w = [1.0004753 1.98949838 2.9463658 3.98989225 4.96608301], F(w) = 0.785111108520491 iteration 340: w = [1.00047559 1.98949857 2.94636573 3.98989223 4.966083 ], F(w) = 0.7851114863496015 iteration 341: w = [1.00047587 1.98949875 2.94636566 3.98989222 4.96608298], F(w) = 0.7851118619124254 iteration 342: w = [1.00047615 1.98949894 2.9463656 3.9898922 4.96608296], F(w) = 0.785112235229204 iteration 343: w = [1.00047644 1.98949912 2.94636553 3.98989219 4.96608294], F(w) = 0.7851126063200494 iteration 344: w = [1.00047671 1.98949931 2.94636546 3.98989217 4.96608292], F(w) = 0.7851129752047401 iteration 345: w = [1.00047699 1.98949949 2.94636539 3.98989216 4.9660829 ], F(w) = 0.7851133419028202 iteration 346: w = [1.00047727 1.98949967 2.94636533 3.98989214 4.96608289], F(w) = 0.7851137064336574 iteration 347: w = [1.00047754 1.98949985 2.94636526 3.98989213 4.96608287], F(w) = 0.7851140688164069 iteration 348: w = [1.00047782 1.98950003 2.9463652 3.98989211 4.96608285], F(w) = 0.7851144290698872 iteration 349: w = [1.00047809 1.98950021 2.94636513 3.9898921 4.96608283], F(w) = 0.7851147872127956 iteration 350: w = [1.00047836 1.98950039 2.94636507 3.98989208 4.96608282], F(w) = 0.785115143263614 iteration 351: w = [1.00047863 1.98950056 2.946365 3.98989207 4.9660828 ], F(w) = 0.7851154972405925 iteration 352: w = [1.00047889 1.98950074 2.94636494 3.98989205 4.96608278], F(w) = 0.7851158491616952 iteration 353: w = [1.00047916 1.98950091 2.94636488 3.98989204 4.96608276], F(w) = 0.785116199044771 iteration 354: w = [1.00047942 1.98950108 2.94636481 3.98989202 4.96608275], F(w) = 0.7851165469074628 iteration 355: w = [1.00047969 1.98950126 2.94636475 3.98989201 4.96608273], F(w) = 0.785116892767187 iteration 356: w = [1.00047995 1.98950143 2.94636469 3.98989199 4.96608271], F(w) = 0.7851172366411079 iteration 357: w = [1.00048021 1.9895016 2.94636462 3.98989198 4.9660827 ], F(w) = 0.7851175785463176 iteration 358: w = [1.00048046 1.98950177 2.94636456 3.98989197 4.96608268], F(w) = 0.7851179184996137 iteration 359: w = [1.00048072 1.98950194 2.9463645 3.98989195 4.96608266], F(w) = 0.7851182565176021 iteration 360: w = [1.00048098 1.9895021 2.94636444 3.98989194 4.96608264], F(w) = 0.7851185926167517 iteration 361: w = [1.00048123 1.98950227 2.94636438 3.98989193 4.96608263], F(w) = 0.7851189268133248 iteration 362: w = [1.00048148 1.98950244 2.94636432 3.98989191 4.96608261], F(w) = 0.7851192591234035 iteration 363: w = [1.00048173 1.9895026 2.94636426 3.9898919 4.9660826 ], F(w) = 0.7851195895628772 iteration 364: w = [1.00048198 1.98950276 2.9463642 3.98989189 4.96608258], F(w) = 0.7851199181474232 iteration 365: w = [1.00048223 1.98950293 2.94636414 3.98989187 4.96608256], F(w) = 0.7851202448926589 iteration 366: w = [1.00048248 1.98950309 2.94636408 3.98989186 4.96608255], F(w) = 0.7851205698139199 iteration 367: w = [1.00048272 1.98950325 2.94636402 3.98989185 4.96608253], F(w) = 0.7851208929264082 iteration 368: w = [1.00048297 1.98950341 2.94636396 3.98989183 4.96608251], F(w) = 0.7851212142451416 iteration 369: w = [1.00048321 1.98950357 2.94636391 3.98989182 4.9660825 ], F(w) = 0.7851215337849993 iteration 370: w = [1.00048345 1.98950373 2.94636385 3.98989181 4.96608248], F(w) = 0.785121851560678 iteration 371: w = [1.00048369 1.98950389 2.94636379 3.98989179 4.96608247], F(w) = 0.7851221675867486 iteration 372: w = [1.00048393 1.98950404 2.94636373 3.98989178 4.96608245], F(w) = 0.7851224818775726 iteration 373: w = [1.00048417 1.9895042 2.94636368 3.98989177 4.96608244], F(w) = 0.7851227944473872 iteration 374: w = [1.00048441 1.98950436 2.94636362 3.98989176 4.96608242], F(w) = 0.7851231053102439 iteration 375: w = [1.00048464 1.98950451 2.94636356 3.98989174 4.96608241], F(w) = 0.7851234144800429 iteration 376: w = [1.00048488 1.98950466 2.94636351 3.98989173 4.96608239], F(w) = 0.7851237219705981 iteration 377: w = [1.00048511 1.98950482 2.94636345 3.98989172 4.96608237], F(w) = 0.785124027795514 iteration 378: w = [1.00048534 1.98950497 2.9463634 3.98989171 4.96608236], F(w) = 0.7851243319682425 iteration 379: w = [1.00048557 1.98950512 2.94636334 3.98989169 4.96608234], F(w) = 0.7851246345021032 iteration 380: w = [1.0004858 1.98950527 2.94636329 3.98989168 4.96608233], F(w) = 0.7851249354103356 iteration 381: w = [1.00048603 1.98950542 2.94636323 3.98989167 4.96608231], F(w) = 0.7851252347059412 iteration 382: w = [1.00048625 1.98950557 2.94636318 3.98989166 4.9660823 ], F(w) = 0.7851255324018243 iteration 383: w = [1.00048648 1.98950572 2.94636313 3.98989165 4.96608228], F(w) = 0.7851258285107569 iteration 384: w = [1.0004867 1.98950586 2.94636307 3.98989163 4.96608227], F(w) = 0.7851261230453455 iteration 385: w = [1.00048693 1.98950601 2.94636302 3.98989162 4.96608226], F(w) = 0.7851264160180994 iteration 386: w = [1.00048715 1.98950616 2.94636297 3.98989161 4.96608224], F(w) = 0.7851267074414412 iteration 387: w = [1.00048737 1.9895063 2.94636291 3.9898916 4.96608223], F(w) = 0.7851269973275652 iteration 388: w = [1.00048759 1.98950645 2.94636286 3.98989159 4.96608221], F(w) = 0.7851272856885887 iteration 389: w = [1.00048781 1.98950659 2.94636281 3.98989158 4.9660822 ], F(w) = 0.785127572536454 iteration 390: w = [1.00048803 1.98950673 2.94636276 3.98989157 4.96608218], F(w) = 0.7851278578830868 iteration 391: w = [1.00048824 1.98950687 2.94636271 3.98989155 4.96608217], F(w) = 0.7851281417401664 iteration 392: w = [1.00048846 1.98950702 2.94636265 3.98989154 4.96608215], F(w) = 0.7851284241193256 iteration 393: w = [1.00048867 1.98950716 2.9463626 3.98989153 4.96608214], F(w) = 0.7851287050320519 iteration 394: w = [1.00048889 1.9895073 2.94636255 3.98989152 4.96608213], F(w) = 0.7851289844897278 iteration 395: w = [1.0004891 1.98950744 2.9463625 3.98989151 4.96608211], F(w) = 0.7851292625035889 iteration 396: w = [1.00048931 1.98950758 2.94636245 3.9898915 4.9660821 ], F(w) = 0.7851295390847881 iteration 397: w = [1.00048952 1.98950771 2.9463624 3.98989149 4.96608209], F(w) = 0.7851298142443517 iteration 398: w = [1.00048973 1.98950785 2.94636235 3.98989148 4.96608207], F(w) = 0.7851300879931978 iteration 399: w = [1.00048994 1.98950799 2.9463623 3.98989147 4.96608206], F(w) = 0.7851303603420933 iteration 400: w = [1.00049014 1.98950812 2.94636225 3.98989145 4.96608204], F(w) = 0.7851306313017814 iteration 401: w = [1.00049035 1.98950826 2.94636221 3.98989144 4.96608203], F(w) = 0.785130900882812 iteration 402: w = [1.00049055 1.98950839 2.94636216 3.98989143 4.96608202], F(w) = 0.785131169095667 iteration 403: w = [1.00049076 1.98950853 2.94636211 3.98989142 4.966082 ], F(w) = 0.785131435950742 iteration 404: w = [1.00049096 1.98950866 2.94636206 3.98989141 4.96608199], F(w) = 0.7851317014582577 iteration 405: w = [1.00049116 1.98950879 2.94636201 3.9898914 4.96608198], F(w) = 0.785131965628416 iteration 406: w = [1.00049136 1.98950892 2.94636196 3.98989139 4.96608196], F(w) = 0.7851322284712663 iteration 407: w = [1.00049156 1.98950906 2.94636192 3.98989138 4.96608195], F(w) = 0.7851324899967711 iteration 408: w = [1.00049176 1.98950919 2.94636187 3.98989137 4.96608194], F(w) = 0.7851327502147704 iteration 409: w = [1.00049196 1.98950932 2.94636182 3.98989136 4.96608193], F(w) = 0.785133009135049 iteration 410: w = [1.00049216 1.98950945 2.94636178 3.98989135 4.96608191], F(w) = 0.7851332667672423 iteration 411: w = [1.00049235 1.98950957 2.94636173 3.98989134 4.9660819 ], F(w) = 0.7851335231209808 iteration 412: w = [1.00049255 1.9895097 2.94636168 3.98989133 4.96608189], F(w) = 0.7851337782056954 iteration 413: w = [1.00049274 1.98950983 2.94636164 3.98989132 4.96608187], F(w) = 0.7851340320307852 iteration 414: w = [1.00049293 1.98950996 2.94636159 3.98989131 4.96608186], F(w) = 0.7851342846055205 iteration 415: w = [1.00049313 1.98951008 2.94636155 3.9898913 4.96608185], F(w) = 0.7851345359391115 iteration 416: w = [1.00049332 1.98951021 2.9463615 3.98989129 4.96608184], F(w) = 0.7851347860407074 iteration 417: w = [1.00049351 1.98951033 2.94636146 3.98989128 4.96608182], F(w) = 0.7851350349192731 iteration 418: w = [1.0004937 1.98951046 2.94636141 3.98989127 4.96608181], F(w) = 0.7851352825837639 iteration 419: w = [1.00049389 1.98951058 2.94636137 3.98989126 4.9660818 ], F(w) = 0.785135529043055 iteration 420: w = [1.00049407 1.98951071 2.94636132 3.98989125 4.96608179], F(w) = 0.7851357743058499 iteration 421: w = [1.00049426 1.98951083 2.94636128 3.98989124 4.96608177], F(w) = 0.7851360183809013 iteration 422: w = [1.00049445 1.98951095 2.94636123 3.98989123 4.96608176], F(w) = 0.785136261276719 iteration 423: w = [1.00049463 1.98951107 2.94636119 3.98989122 4.96608175], F(w) = 0.7851365030018572 iteration 424: w = [1.00049482 1.98951119 2.94636115 3.98989122 4.96608174], F(w) = 0.7851367435647346 iteration 425: w = [1.000495 1.98951131 2.9463611 3.98989121 4.96608173], F(w) = 0.7851369829737227 iteration 426: w = [1.00049518 1.98951143 2.94636106 3.9898912 4.96608171], F(w) = 0.7851372212370656 iteration 427: w = [1.00049536 1.98951155 2.94636102 3.98989119 4.9660817 ], F(w) = 0.7851374583629602 iteration 428: w = [1.00049554 1.98951167 2.94636097 3.98989118 4.96608169], F(w) = 0.7851376943595089 iteration 429: w = [1.00049572 1.98951179 2.94636093 3.98989117 4.96608168], F(w) = 0.7851379292347211 iteration 430: w = [1.0004959 1.98951191 2.94636089 3.98989116 4.96608167], F(w) = 0.7851381629966302 iteration 431: w = [1.00049608 1.98951203 2.94636085 3.98989115 4.96608165], F(w) = 0.7851383956530896 iteration 432: w = [1.00049626 1.98951214 2.9463608 3.98989114 4.96608164], F(w) = 0.7851386272118983 iteration 433: w = [1.00049643 1.98951226 2.94636076 3.98989113 4.96608163], F(w) = 0.7851388576807761 iteration 434: w = [1.00049661 1.98951237 2.94636072 3.98989112 4.96608162], F(w) = 0.7851390870674224 iteration 435: w = [1.00049678 1.98951249 2.94636068 3.98989112 4.96608161], F(w) = 0.7851393153794126 iteration 436: w = [1.00049696 1.9895126 2.94636064 3.98989111 4.9660816 ], F(w) = 0.7851395426242526 iteration 437: w = [1.00049713 1.98951272 2.9463606 3.9898911 4.96608158], F(w) = 0.7851397688094055 iteration 438: w = [1.0004973 1.98951283 2.94636056 3.98989109 4.96608157], F(w) = 0.7851399939422816 iteration 439: w = [1.00049748 1.98951294 2.94636052 3.98989108 4.96608156], F(w) = 0.7851402180301427 iteration 440: w = [1.00049765 1.98951306 2.94636047 3.98989107 4.96608155], F(w) = 0.7851404410802728 iteration 441: w = [1.00049782 1.98951317 2.94636043 3.98989106 4.96608154], F(w) = 0.7851406630998474 iteration 442: w = [1.00049799 1.98951328 2.94636039 3.98989106 4.96608153], F(w) = 0.7851408840959694 iteration 443: w = [1.00049816 1.98951339 2.94636035 3.98989105 4.96608152], F(w) = 0.7851411040756853 iteration 444: w = [1.00049832 1.9895135 2.94636032 3.98989104 4.96608151], F(w) = 0.7851413230460129 iteration 445: w = [1.00049849 1.98951361 2.94636028 3.98989103 4.96608149], F(w) = 0.7851415410138604 iteration 446: w = [1.00049866 1.98951372 2.94636024 3.98989102 4.96608148], F(w) = 0.7851417579860612 iteration 447: w = [1.00049882 1.98951383 2.9463602 3.98989101 4.96608147], F(w) = 0.7851419739694308 iteration 448: w = [1.00049899 1.98951394 2.94636016 3.98989101 4.96608146], F(w) = 0.7851421889706816 iteration 449: w = [1.00049915 1.98951405 2.94636012 3.989891 4.96608145], F(w) = 0.7851424029965248 iteration 450: w = [1.00049932 1.98951415 2.94636008 3.98989099 4.96608144], F(w) = 0.7851426160535441 iteration 451: w = [1.00049948 1.98951426 2.94636004 3.98989098 4.96608143], F(w) = 0.7851428281483025 iteration 452: w = [1.00049964 1.98951437 2.94636 3.98989097 4.96608142], F(w) = 0.7851430392872643 iteration 453: w = [1.0004998 1.98951447 2.94635997 3.98989096 4.96608141], F(w) = 0.7851432494769043 iteration 454: w = [1.00049996 1.98951458 2.94635993 3.98989096 4.9660814 ], F(w) = 0.7851434587235875 iteration 455: w = [1.00050012 1.98951468 2.94635989 3.98989095 4.96608139], F(w) = 0.7851436670336284 iteration 456: w = [1.00050028 1.98951479 2.94635985 3.98989094 4.96608138], F(w) = 0.7851438744133116 iteration 457: w = [1.00050044 1.98951489 2.94635982 3.98989093 4.96608137], F(w) = 0.7851440808688005 iteration 458: w = [1.0005006 1.989515 2.94635978 3.98989093 4.96608136], F(w) = 0.7851442864063073 iteration 459: w = [1.00050076 1.9895151 2.94635974 3.98989092 4.96608135], F(w) = 0.7851444910318743 iteration 460: w = [1.00050091 1.9895152 2.9463597 3.98989091 4.96608133], F(w) = 0.7851446947515957 iteration 461: w = [1.00050107 1.98951531 2.94635967 3.9898909 4.96608132], F(w) = 0.7851448975714144 iteration 462: w = [1.00050122 1.98951541 2.94635963 3.98989089 4.96608131], F(w) = 0.7851450994973083 iteration 463: w = [1.00050138 1.98951551 2.94635959 3.98989089 4.9660813 ], F(w) = 0.7851453005351495 iteration 464: w = [1.00050153 1.98951561 2.94635956 3.98989088 4.96608129], F(w) = 0.7851455006908215 iteration 465: w = [1.00050168 1.98951571 2.94635952 3.98989087 4.96608128], F(w) = 0.7851456999700751 iteration 466: w = [1.00050184 1.98951581 2.94635949 3.98989086 4.96608127], F(w) = 0.7851458983786112 iteration 467: w = [1.00050199 1.98951591 2.94635945 3.98989086 4.96608126], F(w) = 0.7851460959221823 iteration 468: w = [1.00050214 1.98951601 2.94635941 3.98989085 4.96608125], F(w) = 0.7851462926063508 iteration 469: w = [1.00050229 1.98951611 2.94635938 3.98989084 4.96608124], F(w) = 0.7851464884367354 iteration 470: w = [1.00050244 1.98951621 2.94635934 3.98989083 4.96608123], F(w) = 0.78514668341887 iteration 471: w = [1.00050259 1.98951631 2.94635931 3.98989083 4.96608122], F(w) = 0.7851468775582822 iteration 472: w = [1.00050274 1.98951641 2.94635927 3.98989082 4.96608121], F(w) = 0.7851470708603957 iteration 473: w = [1.00050289 1.9895165 2.94635924 3.98989081 4.9660812 ], F(w) = 0.7851472633305996 iteration 474: w = [1.00050303 1.9895166 2.9463592 3.98989081 4.96608119], F(w) = 0.7851474549742562 iteration 475: w = [1.00050318 1.9895167 2.94635917 3.9898908 4.96608118], F(w) = 0.7851476457966177 iteration 476: w = [1.00050333 1.98951679 2.94635913 3.98989079 4.96608118], F(w) = 0.7851478358030054 iteration 477: w = [1.00050347 1.98951689 2.9463591 3.98989078 4.96608117], F(w) = 0.7851480249985772 iteration 478: w = [1.00050362 1.98951698 2.94635907 3.98989078 4.96608116], F(w) = 0.7851482133885693 iteration 479: w = [1.00050376 1.98951708 2.94635903 3.98989077 4.96608115], F(w) = 0.7851484009780704 iteration 480: w = [1.0005039 1.98951717 2.946359 3.98989076 4.96608114], F(w) = 0.7851485877721782 iteration 481: w = [1.00050405 1.98951727 2.94635896 3.98989076 4.96608113], F(w) = 0.7851487737759294 iteration 482: w = [1.00050419 1.98951736 2.94635893 3.98989075 4.96608112], F(w) = 0.7851489589943021 iteration 483: w = [1.00050433 1.98951745 2.9463589 3.98989074 4.96608111], F(w) = 0.785149143432289 iteration 484: w = [1.00050447 1.98951755 2.94635886 3.98989073 4.9660811 ], F(w) = 0.7851493270947818 iteration 485: w = [1.00050461 1.98951764 2.94635883 3.98989073 4.96608109], F(w) = 0.7851495099866547 iteration 486: w = [1.00050475 1.98951773 2.9463588 3.98989072 4.96608108], F(w) = 0.7851496921127462 iteration 487: w = [1.00050489 1.98951782 2.94635877 3.98989071 4.96608107], F(w) = 0.7851498734778439 iteration 488: w = [1.00050503 1.98951792 2.94635873 3.98989071 4.96608106], F(w) = 0.7851500540866997 iteration 489: w = [1.00050517 1.98951801 2.9463587 3.9898907 4.96608105], F(w) = 0.785150233944051 iteration 490: w = [1.00050531 1.9895181 2.94635867 3.98989069 4.96608104], F(w) = 0.7851504130545109 iteration 491: w = [1.00050545 1.98951819 2.94635864 3.98989069 4.96608103], F(w) = 0.7851505914227966 iteration 492: w = [1.00050558 1.98951828 2.9463586 3.98989068 4.96608103], F(w) = 0.7851507690534424 iteration 493: w = [1.00050572 1.98951837 2.94635857 3.98989067 4.96608102], F(w) = 0.7851509459510411 iteration 494: w = [1.00050586 1.98951846 2.94635854 3.98989067 4.96608101], F(w) = 0.7851511221200721 iteration 495: w = [1.00050599 1.98951855 2.94635851 3.98989066 4.966081 ], F(w) = 0.7851512975650744 iteration 496: w = [1.00050613 1.98951864 2.94635848 3.98989065 4.96608099], F(w) = 0.7851514722904505 iteration 497: w = [1.00050626 1.98951872 2.94635844 3.98989065 4.96608098], F(w) = 0.785151646300623 iteration 498: w = [1.00050639 1.98951881 2.94635841 3.98989064 4.96608097], F(w) = 0.7851518196000051 iteration 499: w = [1.00050653 1.9895189 2.94635838 3.98989064 4.96608096], F(w) = 0.7851519921929033
Summary¶
$\tiny{\text{YouTube-Stanford-CS221-Percy Liang}}$